-- Logs begin at Sat 2022-07-02 20:01:18 UTC, end at Sat 2022-07-02 21:04:16 UTC. -- Jul 02 20:36:15.038176 dv-osbrick-master-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 02 20:36:15.047065 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 02 20:36:15.049074 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jul 2 20:36:15 2022] *** Jul 02 20:36:15.049074 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 02 20:36:15.049074 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 02 20:36:15.049074 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: nodename: dv-osbrick-master-4-ceph Jul 02 20:36:15.049074 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: machine: x86_64 Jul 02 20:36:15.049074 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: clock source: unix Jul 02 20:36:15.049074 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: pcre jit disabled Jul 02 20:36:15.049074 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: detected number of CPU cores: 4 Jul 02 20:36:15.049074 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: current working directory: / Jul 02 20:36:15.049074 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: detected binary path: /usr/bin/uwsgi-core Jul 02 20:36:15.049706 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: your processes number limit is 47680 Jul 02 20:36:15.049706 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: your memory page size is 4096 bytes Jul 02 20:36:15.049706 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: detected max file descriptor number: 2048 Jul 02 20:36:15.049706 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: lock engine: pthread robust mutexes Jul 02 20:36:15.049706 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: thunder lock: enabled Jul 02 20:36:15.049706 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 02 20:36:15.049706 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 02 20:36:15.097951 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: Python main interpreter initialized at 0x55d2e1a129c0 Jul 02 20:36:15.097951 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: python threads support enabled Jul 02 20:36:15.097951 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: your server socket listen backlog is limited to 100 connections Jul 02 20:36:15.097951 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: your mercy for graceful operations on workers is 90 seconds Jul 02 20:36:15.098292 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: mapped 403077 bytes (393 KB) for 2 cores Jul 02 20:36:15.098353 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: *** Operational MODE: preforking *** Jul 02 20:36:15.098644 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: *** uWSGI is running in multiple interpreter mode *** Jul 02 20:36:15.098644 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: spawned uWSGI master process (pid: 98921) Jul 02 20:36:15.098826 dv-osbrick-master-4-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 02 20:36:15.103019 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: spawned uWSGI worker 1 (pid: 98933, cores: 1) Jul 02 20:36:15.103019 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: spawned uWSGI worker 2 (pid: 98934, cores: 1) Jul 02 20:36:15.103019 dv-osbrick-master-4-ceph devstack@keystone.service[98921]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 02 20:36:20.738839 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 20:36:20.738839 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: from cryptography.utils import int_from_bytes Jul 02 20:36:20.739547 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 20:36:20.739547 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: from cryptography.utils import int_from_bytes Jul 02 20:36:20.772413 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 20:36:20.772413 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: from cryptography.utils import int_from_bytes Jul 02 20:36:20.772965 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 02 20:36:20.772965 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: from cryptography.utils import int_from_bytes Jul 02 20:36:20.788019 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 02 20:36:20.788165 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 02 20:36:20.788382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] command line args: [] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 02 20:36:20.788639 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 02 20:36:20.788776 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ================================================================================ {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 02 20:36:20.789055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] admin_token = **** {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.789290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] config_dir = [] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.789493 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.789646 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] config_source = [] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.789838 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] debug = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.790029 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.790941 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.790941 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] insecure_debug = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.790941 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.791163 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.791229 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] list_limit = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.791584 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] log_config_append = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.791584 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.791791 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] log_dir = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.791917 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] log_file = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.792161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.792408 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.792649 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.792886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.793044 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.793219 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.793458 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.793718 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.793925 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.794271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.794509 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.794739 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.795011 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.795256 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] notification_format = cadf {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.795528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.796018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.796197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] publish_errors = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.796428 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.796654 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.796830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.797072 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.797304 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.797533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] standard_threads = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.797760 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] strict_password_check = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.797998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.798170 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] use_eventlog = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.798344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] use_journal = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.798515 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] use_json = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.798688 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] use_stderr = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.798858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] use_syslog = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.799253 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] watch_log_file = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.799512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.799806 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.800103 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.800342 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.800589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.800826 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.801068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.801299 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.801541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.801782 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.802027 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.802256 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.802497 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.802728 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.802994 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.803239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.803471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.803718 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.803964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.804201 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.804437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.804682 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.804936 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.805180 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.805424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.805648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.805872 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.806099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.806328 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.806568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.806810 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.807059 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.807284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.807523 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.807764 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.807996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.808240 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.808466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.808696 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.808923 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.809148 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.809372 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.809594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.809816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.810045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.810286 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.810510 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.810740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.810987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.811219 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.811454 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.811694 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.811919 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.812150 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.812380 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.812611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.812840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.813069 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.813293 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.813534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.813767 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.813998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.814223 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.814481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.814752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.815079 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.815322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.815554 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.815816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.816051 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.816295 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.816535 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.816779 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.816999 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.817231 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.817474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.enabled = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.817713 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.817944 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.818184 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.818419 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.818650 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.818882 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.819136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.819368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.819627 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.819863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.820100 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.820353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.820571 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.820807 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.821039 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.821271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.821496 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.821618 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 02 20:36:20.821750 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 02 20:36:20.821875 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.822007 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] command line args: [] {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 02 20:36:20.822131 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.822254 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 02 20:36:20.822377 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.822497 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ================================================================================ {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 02 20:36:20.822618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.822749 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] admin_token = **** {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.822875 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.823042 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] config_dir = [] {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.823167 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.823293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.823416 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.823549 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] config_source = [] {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.823670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.823800 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] debug = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.823800 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.824068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.824201 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.824325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.824454 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] insecure_debug = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.824588 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.824711 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.824835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] auth.external = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.824966 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.825090 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] auth.mapped = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.825213 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] list_limit = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.825337 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.825466 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] log_config_append = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.825466 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.825737 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.825848 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] log_dir = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.825974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] auth.password = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.826093 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] log_file = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.826228 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] auth.token = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.826359 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.826483 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.826606 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.826729 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] catalog.caching = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.826852 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.826988 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.827126 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.827259 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.827381 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.827548 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.827670 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.828116 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.828250 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.828376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.828499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.828624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] credential.caching = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.828766 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.828842 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] credential.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.828926 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.829003 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.829119 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.829119 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.829256 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.829256 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.829392 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.829464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.829563 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] notification_format = cadf {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.829680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.829760 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.829841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.829841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.829969 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.57/identity {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.830047 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.830126 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] publish_errors = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.830198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.830295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.830467 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.830612 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.830612 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.830879 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.830879 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.831165 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.831249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.831328 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.831400 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.831470 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] standard_threads = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.831546 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] federation.caching = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.831626 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] strict_password_check = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.831705 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.831777 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.831847 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] federation.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.831918 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] use_eventlog = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.831987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.832066 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] use_journal = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.832175 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] use_json = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.832261 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.832333 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] use_stderr = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.832409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.832488 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] use_syslog = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.832657 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.832781 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] watch_log_file = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 02 20:36:20.832861 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.832972 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.833130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.833271 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.833353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.833433 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.833591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.833714 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.833793 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.833918 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.834008 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.caching = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.834146 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.834232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.834424 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.834559 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.834660 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.834738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.834896 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.835051 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.835131 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.835204 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.835403 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.835526 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.835605 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.835691 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.835870 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.835992 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.836091 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.836168 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.836328 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.836450 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.836530 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.836613 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.836776 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.836902 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.836981 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.837054 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.837229 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.837354 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.837510 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.837598 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.837679 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.837754 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.837930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.838054 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.838174 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.838279 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.838440 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.838564 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.838643 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.838716 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.838867 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.838994 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.839122 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.839206 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.839348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.839439 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.839577 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.839674 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.839830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.839930 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.840035 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.840143 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.840275 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.840381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.840487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.840570 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.840738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.840821 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.840980 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.841070 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.841207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.841290 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.841447 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.841541 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.841676 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.841759 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.841899 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.841989 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.842128 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.842217 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.842335 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.password = **** {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.842415 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.842562 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.842649 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.842790 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.842868 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.843040 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.843133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.843272 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.843359 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.843506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.843593 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.843732 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.843811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.843974 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.844062 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.844202 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.844280 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.844426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.844515 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.844658 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.844744 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.844897 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.844982 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.845123 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.845202 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.845350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.845437 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.845581 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.845668 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.845805 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.845931 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.846154 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.846392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.846392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.846629 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.846864 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.846990 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.847126 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.847221 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.847366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.847447 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.847594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.847674 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.847818 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.847907 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.848047 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.848128 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.848278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.848360 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.848507 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.848600 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.848731 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.848810 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.848966 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.849044 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.849201 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.849289 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.849437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.849516 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.849676 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.849756 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.849914 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.850002 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.850137 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.850217 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.850376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.850457 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.850609 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.850770 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.850848 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.850983 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.851065 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.851137 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.enabled = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.851300 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.851400 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.851540 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.851620 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.851779 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.851859 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.852011 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.852099 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.852247 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.852325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] policy.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.852471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.852549 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.852705 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.852792 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.852935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.853013 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.853165 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] receipt.caching = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.853245 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.853397 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.853485 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.853638 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.853718 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.853874 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.853952 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.854099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.854179 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.854332 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.854412 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.854567 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] resource.caching = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.854645 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.854804 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.854883 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.855060 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.855144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] resource.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.855287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.855366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.855516 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.855596 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.855754 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.855834 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.855985 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.856065 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] revoke.caching = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.856223 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.856302 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.856455 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.856534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.856687 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] role.cache_time = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.856765 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.856918 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] role.caching = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.856999 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.857160 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] role.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.857240 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.857385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] role.list_limit = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.857464 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.857628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.857709 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.857857 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] auth.external = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.857935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.858092 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] auth.mapped = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.858200 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.858335 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.858412 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.858575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.858670 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.858814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.858916 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] auth.password = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.859066 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] auth.token = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.859147 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.859308 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.859389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.859531 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.859609 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] catalog.caching = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.859771 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.859852 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.859998 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.860076 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.860242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.860320 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.860481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.860562 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.860709 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.860877 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.860955 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] credential.caching = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.861107 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.861194 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] credential.driver = sql {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.861350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.861430 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.861638 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.861878 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.861965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.862123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.862243 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.862348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.862429 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.862582 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.862669 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.862826 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.862949 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.863082 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.863173 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.863308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.863396 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.863533 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.863612 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.863756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.863835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.864004 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.864180 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.864314 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.864445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.864572 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.864698 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.864824 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.864958 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.865085 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.865211 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] federation.caching = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.865338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] token.cache_time = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.865465 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.865592 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] token.caching = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.865730 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] federation.driver = sql {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.865862 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.865988 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.866114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] token.provider = fernet {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.866239 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.866364 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.866499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.866627 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.866753 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.866878 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.867057 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.867184 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.867320 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.867447 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.867584 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.867710 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.867835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.867960 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] trust.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.868093 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.868219 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.868345 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] identity.caching = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.868469 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.868596 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.868721 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.868854 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.868980 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.869105 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.869230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.869364 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.869489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.869623 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] identity.driver = sql {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.869749 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.869874 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.869998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.870123 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.870248 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.connection = **** {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.870388 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.870526 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.870659 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.870788 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.870928 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.871051 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.871187 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.871325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.871451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.871576 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.871702 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.871828 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.871953 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.872151 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.872279 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.872405 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.872530 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.872656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.872782 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.872926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.872926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.873163 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.873288 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.873413 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.873538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.873671 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.873797 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.873923 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.874047 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.874172 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.874296 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.874429 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.874554 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.874689 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.874815 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.874953 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.875076 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98933) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 02 20:36:20.875212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.875212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.875212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.875212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.875212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.875212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.875212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.876008 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.876008 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.876008 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.876008 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.password = **** {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.876469 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.876469 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.876712 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.876870 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.877116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.877870 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.878135 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.878326 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.878590 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.878815 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.879069 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.879339 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.879576 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.879810 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.880038 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.user = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.880276 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.880550 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.880783 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.881029 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.881257 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.881501 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.881734 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.881959 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.882354 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.882442 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.882622 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.882849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.883122 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.883367 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.883612 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.883856 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.884100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.884334 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.884581 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.884819 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.885053 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.885289 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.885525 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.885770 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.886015 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.886253 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.886505 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] policy.driver = sql {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.886735 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.887000 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.887238 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.887474 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] receipt.caching = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.887711 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.887956 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.888197 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.888426 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.888661 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.888900 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] resource.caching = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.889149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.889397 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] resource.driver = sql {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.889630 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.889880 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.890129 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.890362 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] revoke.caching = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.890607 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.890844 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.891107 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] role.cache_time = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.891341 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] role.caching = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.891588 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] role.driver = sql {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.891816 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] role.list_limit = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.892064 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.892311 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.892557 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.892854 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.893656 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.893908 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.894161 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.894414 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.894653 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.894921 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.895172 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.895422 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.895673 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.896078 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.896311 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.896562 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.896813 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.897062 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.897312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.897547 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.897802 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.898053 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.898292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.898522 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.898755 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.899018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.899271 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.899525 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.899773 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.900020 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.900254 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.900486 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] token.cache_time = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.900722 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] token.caching = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.900959 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.901205 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] token.provider = fernet {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.901442 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.901697 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.901944 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.902180 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.902260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:20.902424 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.902504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:20.902666 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.902754 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:20.902926 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] trust.driver = sql {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.903242 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.903480 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.903713 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.903957 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.904203 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.904434 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.904676 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.904974 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.905233 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] database.connection = **** {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.905476 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.905720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.905957 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.906204 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.906429 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.906666 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.906925 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.907169 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.907418 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.907654 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.907909 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.908146 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.908445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.908853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.909108 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.909332 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.909574 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.909810 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 02 20:36:20.909981 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=98934) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 02 20:36:20.911201 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:20.935228 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:20.935454 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:20.935679 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:20.938472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:20.938698 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:20.944656 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:20.963422 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:20.963654 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:20.991899 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.001865 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.039745 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.039986 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.043822 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.044057 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.105544 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.105720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.105967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.106150 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.106306 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.106448 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.106526 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.106614 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.106700 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.106935 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.107181 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.107395 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.129567 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.129781 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.130010 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.130255 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.130387 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.130467 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.130552 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.130618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.130816 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.130966 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.131104 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.131200 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.131406 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.131618 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.142122 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.142376 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.154927 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.155271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.155393 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.155523 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.155607 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.155672 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.155758 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.155835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.155898 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.156020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.156098 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.156171 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98933) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.156246 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.156445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=98934) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 02 20:36:21.173292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.173503 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 02 20:36:21.173833 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.174058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 02 20:36:21.174323 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.174577 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.174820 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.175089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.175187 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.175389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 02 20:36:21.175727 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.175929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 02 20:36:21.176206 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.176492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.176699 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.176955 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.185944 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.186213 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.186467 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.186737 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.187994 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.188267 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.188532 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.188811 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.194875 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.197467 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=98934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.198142 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.198419 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.198693 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.198962 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.199263 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.199510 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.199778 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.200045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.200406 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.200670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.200794 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=98934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.200921 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.201055 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.201263 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.201540 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.201816 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.202071 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.202330 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.203023 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.203305 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.203574 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.203838 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.227528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.229130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.229399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.231124 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.232858 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=98934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.233142 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.234710 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.235000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.235271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.238944 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=98934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.239191 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.239494 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.242549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.242768 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.246761 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=98934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.247065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.247191 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.247481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.247755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.248026 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.248408 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.248680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.248939 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.249203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.251556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=98934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.251957 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.252289 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.253086 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.253368 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.253625 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.253900 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.254167 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.268354 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.268627 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.273271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.273463 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.273765 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.276909 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.277194 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.278445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=98934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.282104 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.282228 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.282349 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.285921 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.287591 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=98934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.289550 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.289843 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.290120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.291236 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=98934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.291941 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.292228 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.292509 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.296436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.296740 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.297025 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.297312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.297588 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.297881 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.311555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.311834 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.312093 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.312362 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.317883 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=98934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.318170 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.318432 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.318690 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.320365 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.322072 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.322340 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.325370 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.325639 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.325909 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.326192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.326468 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.326813 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.328952 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.329227 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.332398 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=98934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.332677 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.332957 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.333239 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.333512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.340201 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.340472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.340744 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.341023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.341276 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.341561 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.341825 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.347426 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=98934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.347704 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.347982 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.348271 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.348558 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.348829 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.349084 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.359565 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.362947 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.366239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.367695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=98934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.367822 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.369487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.369756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.370031 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.370937 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=98934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.374258 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.375881 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.377429 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.377943 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=98934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.378221 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.378511 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.379053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.382203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.382492 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.382771 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.383074 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.385944 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.387610 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=98934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.390775 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.391094 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.391378 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.391663 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.392094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.392371 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.392641 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.400601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=98933) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.400872 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.401145 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.401271 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=98934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.401373 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.401590 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.401717 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.401913 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.402039 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.402244 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.402458 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.402712 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.402995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.403258 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.403494 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.403769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.404034 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=98933) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.410432 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=98934) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 02 20:36:21.410706 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.411004 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.411272 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.411538 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.411835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.412104 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.412383 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.412629 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.412893 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.413156 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.413410 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.413680 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.413955 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=98934) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 02 20:36:21.442201 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d2e1a129c0 pid: 98933 (default app) Jul 02 20:36:21.445525 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4980b-ef08-40ef-93e0-e7eb6afaa0d1 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:21.445808 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4980b-ef08-40ef-93e0-e7eb6afaa0d1 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:21.446080 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a4980b-ef08-40ef-93e0-e7eb6afaa0d1 None None] PATH_INFO: `/v3` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:21.450368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 791 bytes} [Sat Jul 2 20:36:21 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:21.453517 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d2e1a129c0 pid: 98934 (default app) Jul 02 20:36:29.637450 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6efbe-bc1f-48e1-a18b-f1e54c1bc3a5 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:29.638049 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6efbe-bc1f-48e1-a18b-f1e54c1bc3a5 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:29.638049 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6efbe-bc1f-48e1-a18b-f1e54c1bc3a5 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:29.639346 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:36:29.649456 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3d6b7-7954-4515-84e7-4fe9958688b8 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:29.650344 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3d6b7-7954-4515-84e7-4fe9958688b8 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:29.650344 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3d6b7-7954-4515-84e7-4fe9958688b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:29.728588 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: INFO dbcounter [None req-cfb3d6b7-7954-4515-84e7-4fe9958688b8 None None] Registered counter for database keystone Jul 02 20:36:29.753618 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG oslo_db.sqlalchemy.engines [None req-cfb3d6b7-7954-4515-84e7-4fe9958688b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98934) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 20:36:29.765234 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writer thread running {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 20:36:30.057633 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG passlib.handlers.bcrypt [None req-cfb3d6b7-7954-4515-84e7-4fe9958688b8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=98934) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 02 20:36:30.058039 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG passlib.handlers.bcrypt [None req-cfb3d6b7-7954-4515-84e7-4fe9958688b8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=98934) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 02 20:36:30.113303 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-cfb3d6b7-7954-4515-84e7-4fe9958688b8 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:36:30.114882 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-cfb3d6b7-7954-4515-84e7-4fe9958688b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:36:30.244227 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 1/3] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:36:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 600 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 02 20:36:30.414532 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6efbe-bc1f-48e1-a18b-f1e54c1bc3a5 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:30.494196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: INFO dbcounter [None req-7ec6efbe-bc1f-48e1-a18b-f1e54c1bc3a5 None None] Registered counter for database keystone Jul 02 20:36:30.515467 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG oslo_db.sqlalchemy.engines [None req-7ec6efbe-bc1f-48e1-a18b-f1e54c1bc3a5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=98933) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 02 20:36:30.526716 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writer thread running {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 02 20:36:30.656826 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6efbe-bc1f-48e1-a18b-f1e54c1bc3a5 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:30.665969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ca1d89-d3ca-43a6-ba92-81a6c50d90ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:30.666967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca1d89-d3ca-43a6-ba92-81a6c50d90ba admin admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:30.667462 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca1d89-d3ca-43a6-ba92-81a6c50d90ba admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:30.668001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ca1d89-d3ca-43a6-ba92-81a6c50d90ba admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:30.679778 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca1d89-d3ca-43a6-ba92-81a6c50d90ba admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:30.836892 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f5ca1d89-d3ca-43a6-ba92-81a6c50d90ba admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 02 20:36:30.837230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ca1d89-d3ca-43a6-ba92-81a6c50d90ba admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:30.849030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 3/4] 10.222.0.57 () {58 vars in 1324 bytes} [Sat Jul 2 20:36:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 20:36:30.858899 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3d6b7-7954-4515-84e7-4fe9958688b8 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:30.882397 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3d6b7-7954-4515-84e7-4fe9958688b8 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:30.888965 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b712d-311e-4c16-907b-189ad75d40b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:30.890102 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b712d-311e-4c16-907b-189ad75d40b4 admin admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:30.890387 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b712d-311e-4c16-907b-189ad75d40b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:30.890665 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b712d-311e-4c16-907b-189ad75d40b4 admin admin] PATH_INFO: `/v3/projects/48e1bdb53b064749bf22c6e982f8a7ab` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:30.892586 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b712d-311e-4c16-907b-189ad75d40b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=48e1bdb53b064749bf22c6e982f8a7ab)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:30.945396 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: WARNING keystone.common.rbac_enforcer.enforcer [None req-990b712d-311e-4c16-907b-189ad75d40b4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 02 20:36:30.945670 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990b712d-311e-4c16-907b-189ad75d40b4 admin admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:30.950366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 2/5] 10.222.0.57 () {56 vars in 1207 bytes} [Sat Jul 2 20:36:30 2022] GET /identity/v3/projects/48e1bdb53b064749bf22c6e982f8a7ab => generated 344 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:33.178052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517a0c2-90da-42e2-a574-746c79f93838 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:33.178632 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517a0c2-90da-42e2-a574-746c79f93838 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:33.178632 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517a0c2-90da-42e2-a574-746c79f93838 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:33.182696 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 4/6] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:36:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:36:33.191033 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853461b-c7ea-4aa4-a76e-5175e241a670 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:33.191487 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853461b-c7ea-4aa4-a76e-5175e241a670 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:33.191587 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853461b-c7ea-4aa4-a76e-5175e241a670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:33.212192 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-7853461b-c7ea-4aa4-a76e-5175e241a670 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:36:33.213715 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-7853461b-c7ea-4aa4-a76e-5175e241a670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:36:33.223761 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 3/7] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:36:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 02 20:36:33.248214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517a0c2-90da-42e2-a574-746c79f93838 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:33.263654 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517a0c2-90da-42e2-a574-746c79f93838 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:33.268734 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4bb3b-86a2-49ab-ad22-aeaaef506dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:33.269382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4bb3b-86a2-49ab-ad22-aeaaef506dbc admin admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:33.269671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4bb3b-86a2-49ab-ad22-aeaaef506dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:33.269948 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4bb3b-86a2-49ab-ad22-aeaaef506dbc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:33.277858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4bb3b-86a2-49ab-ad22-aeaaef506dbc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:33.279691 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4bb3b-86a2-49ab-ad22-aeaaef506dbc admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:33.289466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 5/8] 10.222.0.57 () {58 vars in 1324 bytes} [Sat Jul 2 20:36:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 02 20:36:33.296945 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853461b-c7ea-4aa4-a76e-5175e241a670 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:33.307548 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853461b-c7ea-4aa4-a76e-5175e241a670 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:33.315499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ffd63-0ee7-463e-a255-151ea8c80114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:33.316385 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ffd63-0ee7-463e-a255-151ea8c80114 admin admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:33.316662 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ffd63-0ee7-463e-a255-151ea8c80114 admin admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:33.316929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ffd63-0ee7-463e-a255-151ea8c80114 admin admin] PATH_INFO: `/v3/users/a74d0c542d434c4296a1d1b26dca9bac` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:33.318445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ffd63-0ee7-463e-a255-151ea8c80114 admin admin] RBAC: Authorizing `identity:get_user(user_id=a74d0c542d434c4296a1d1b26dca9bac)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:33.320347 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ffd63-0ee7-463e-a255-151ea8c80114 admin admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:33.321989 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 4/9] 10.222.0.57 () {56 vars in 1198 bytes} [Sat Jul 2 20:36:33 2022] GET /identity/v3/users/a74d0c542d434c4296a1d1b26dca9bac => generated 247 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:35.713970 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1d83c-b2fe-431d-9315-996549850d51 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:35.714559 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1d83c-b2fe-431d-9315-996549850d51 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:35.714559 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1d83c-b2fe-431d-9315-996549850d51 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:35.717062 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:36:35.722059 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16457a6-8cb5-424a-b3b4-0ccd46d10c91 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:35.722508 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16457a6-8cb5-424a-b3b4-0ccd46d10c91 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:35.722690 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16457a6-8cb5-424a-b3b4-0ccd46d10c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:35.741360 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-f16457a6-8cb5-424a-b3b4-0ccd46d10c91 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:36:35.742566 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-f16457a6-8cb5-424a-b3b4-0ccd46d10c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:36:35.766861 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b520c6-14d9-4274-8a06-e9050de2bc12 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:35.767176 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b520c6-14d9-4274-8a06-e9050de2bc12 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:35.767499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b520c6-14d9-4274-8a06-e9050de2bc12 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:35.769067 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 7/11] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:36:35.774553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374b6f5-8bb9-435c-9022-05e31ad6887e None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:35.774838 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374b6f5-8bb9-435c-9022-05e31ad6887e None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:35.775143 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374b6f5-8bb9-435c-9022-05e31ad6887e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:35.818572 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG passlib.handlers.bcrypt [None req-d374b6f5-8bb9-435c-9022-05e31ad6887e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=98933) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 02 20:36:35.819020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG passlib.handlers.bcrypt [None req-d374b6f5-8bb9-435c-9022-05e31ad6887e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=98933) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 02 20:36:35.831436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 5/12] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:36:35.855581 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16457a6-8cb5-424a-b3b4-0ccd46d10c91 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:35.864463 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-d374b6f5-8bb9-435c-9022-05e31ad6887e None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:36:35.866067 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-d374b6f5-8bb9-435c-9022-05e31ad6887e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:36:35.881357 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:35.963189 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16457a6-8cb5-424a-b3b4-0ccd46d10c91 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:35.965106 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 8/13] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:36:35.989051 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374b6f5-8bb9-435c-9022-05e31ad6887e None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:35.999141 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e06916-de01-4fe5-8b7e-8e5c85eb63ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:35.999802 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e06916-de01-4fe5-8b7e-8e5c85eb63ce None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:36.000079 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e06916-de01-4fe5-8b7e-8e5c85eb63ce None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:36.000352 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e06916-de01-4fe5-8b7e-8e5c85eb63ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:36.068377 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e06916-de01-4fe5-8b7e-8e5c85eb63ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:36.069880 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e06916-de01-4fe5-8b7e-8e5c85eb63ce None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:36.094057 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:36.097577 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374b6f5-8bb9-435c-9022-05e31ad6887e None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:36.100046 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:36.136266 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee908f7-6370-4274-aa3e-a6e0d2e21859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:36.137379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee908f7-6370-4274-aa3e-a6e0d2e21859 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:36.137711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee908f7-6370-4274-aa3e-a6e0d2e21859 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:36.138049 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee908f7-6370-4274-aa3e-a6e0d2e21859 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:36.153874 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee908f7-6370-4274-aa3e-a6e0d2e21859 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:36:36.166995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-4ee908f7-6370-4274-aa3e-a6e0d2e21859 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:36:36.166995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:36:36.166995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:36:36.166995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:36:36.166995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:36:36.166995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:36:36.166995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:36:36.166995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:36:36.166995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:36:36.166995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:36:36.166995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:36:36.166995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:36:36.166995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:36:36.166995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:36:36.166995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:36:36.166995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:36:36.168038 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:36:36.168038 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:36:36.168038 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:36:36.168038 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:36:36.168038 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:36:36.168038 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:36:36.168038 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:36:36.168038 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:36:36.168038 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:36:36.168038 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:36:36.168038 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:36:36.168038 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:36:36.168038 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:36:36.168038 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:36:36.168038 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:36:36.168038 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:36:36.168905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:36:36.168905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:36:36.168905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:36:36.168905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:36:36.168905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:36:36.168905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:36:36.168905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:36:36.168905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:36:36.168905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:36:36.168905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:36:36.168905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:36:36.168905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:36:36.168905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 9/14] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jul 2 20:36:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:36:36.173041 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 6/15] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:36:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 02 20:36:36.174271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee908f7-6370-4274-aa3e-a6e0d2e21859 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:36.178699 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e06916-de01-4fe5-8b7e-8e5c85eb63ce None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:36.277363 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee908f7-6370-4274-aa3e-a6e0d2e21859 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:36.278626 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e06916-de01-4fe5-8b7e-8e5c85eb63ce None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:36.302973 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:36.311913 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392e922-319d-442e-adf9-99196933bfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:36.312591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392e922-319d-442e-adf9-99196933bfc1 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:36.312925 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392e922-319d-442e-adf9-99196933bfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:36.313202 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392e922-319d-442e-adf9-99196933bfc1 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:36.313979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392e922-319d-442e-adf9-99196933bfc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:36:36.314326 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392e922-319d-442e-adf9-99196933bfc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:36.315824 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4392e922-319d-442e-adf9-99196933bfc1 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:36.316751 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a6216-4996-4ea2-9297-e0bb08b5421f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:36.317954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a6216-4996-4ea2-9297-e0bb08b5421f None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:36.318787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a6216-4996-4ea2-9297-e0bb08b5421f None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:36.319675 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a6216-4996-4ea2-9297-e0bb08b5421f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:36.328261 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 10/16] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:36:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:36:36.334114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392e922-319d-442e-adf9-99196933bfc1 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:36.334733 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a6216-4996-4ea2-9297-e0bb08b5421f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:36.336813 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a6216-4996-4ea2-9297-e0bb08b5421f None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:36.361428 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:36.364451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-0c9a6216-4996-4ea2-9297-e0bb08b5421f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:36:36.364451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:36:36.364451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:36:36.364451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:36:36.364451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:36:36.364451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:36:36.364451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:36:36.364451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:36:36.364451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:36:36.364451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:36:36.364451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:36:36.364451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:36:36.364451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:36:36.364451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:36:36.364451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:36:36.365731 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:36:36.365731 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:36:36.365731 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:36:36.365731 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:36:36.365731 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:36:36.365731 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:36:36.365731 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:36:36.365731 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:36:36.365731 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:36:36.365731 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:36:36.365731 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:36:36.365731 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:36:36.365731 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:36:36.365731 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:36:36.365731 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:36:36.365731 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:36:36.365731 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:36:36.367165 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:36:36.367165 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:36:36.367165 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:36:36.367165 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:36:36.367165 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 7/17] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:36:36.373782 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a6216-4996-4ea2-9297-e0bb08b5421f None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:36.436820 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4392e922-319d-442e-adf9-99196933bfc1 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:36.473507 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11fc443-c908-417c-8570-1fb6d28294a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:36.474850 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fc443-c908-417c-8570-1fb6d28294a3 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:36.475274 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fc443-c908-417c-8570-1fb6d28294a3 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:36.475689 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fc443-c908-417c-8570-1fb6d28294a3 None admin] PATH_INFO: `/v3/users/a74d0c542d434c4296a1d1b26dca9bac` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:36.478394 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11fc443-c908-417c-8570-1fb6d28294a3 None admin] RBAC: Authorizing `identity:get_user(user_id=a74d0c542d434c4296a1d1b26dca9bac)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:36.480892 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11fc443-c908-417c-8570-1fb6d28294a3 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:36.484163 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 11/18] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:36:36 2022] GET /identity/v3/users/a74d0c542d434c4296a1d1b26dca9bac => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:36:36.489728 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11fc443-c908-417c-8570-1fb6d28294a3 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:36.498358 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a6216-4996-4ea2-9297-e0bb08b5421f None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:36.535398 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31eccf-12f2-45be-92bb-11bf0d23b8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:36.536075 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31eccf-12f2-45be-92bb-11bf0d23b8bc None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:36.536404 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31eccf-12f2-45be-92bb-11bf0d23b8bc None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:36.536730 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31eccf-12f2-45be-92bb-11bf0d23b8bc None admin] PATH_INFO: `/v3/domains` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:36.537553 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31eccf-12f2-45be-92bb-11bf0d23b8bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:36:36.537910 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31eccf-12f2-45be-92bb-11bf0d23b8bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:36.539589 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31eccf-12f2-45be-92bb-11bf0d23b8bc None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:36.558488 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 8/19] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:36.592749 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:36.601963 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11fc443-c908-417c-8570-1fb6d28294a3 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:36.642662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5d8ea-edd5-490b-955a-ea849501dae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:36.644234 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5d8ea-edd5-490b-955a-ea849501dae9 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:36.644518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5d8ea-edd5-490b-955a-ea849501dae9 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:36.644789 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5d8ea-edd5-490b-955a-ea849501dae9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:36.646074 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5d8ea-edd5-490b-955a-ea849501dae9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:36.647642 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5d8ea-edd5-490b-955a-ea849501dae9 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:36.649296 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 12/20] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:36:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:36:36.655511 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31eccf-12f2-45be-92bb-11bf0d23b8bc None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:36.696473 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:36.770704 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31eccf-12f2-45be-92bb-11bf0d23b8bc None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:36.809402 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca8fb97-a308-4c55-8464-d2aa4a9a2385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:36.810241 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8fb97-a308-4c55-8464-d2aa4a9a2385 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:36.810597 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8fb97-a308-4c55-8464-d2aa4a9a2385 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:36.810944 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca8fb97-a308-4c55-8464-d2aa4a9a2385 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:36.812000 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8fb97-a308-4c55-8464-d2aa4a9a2385 None admin] RBAC: Adding query filter params (role.id=353a58700c5640988ce2c9012e847cf8, scope.domain.id=default, user.id=a74d0c542d434c4296a1d1b26dca9bac) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:36:36.812388 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8fb97-a308-4c55-8464-d2aa4a9a2385 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:36.814703 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca8fb97-a308-4c55-8464-d2aa4a9a2385 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:36.824266 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 9/21] 10.222.0.57 () {56 vars in 1322 bytes} [Sat Jul 2 20:36:36 2022] GET /identity/v3/role_assignments?user.id=a74d0c542d434c4296a1d1b26dca9bac&scope.domain.id=default&role.id=353a58700c5640988ce2c9012e847cf8 => generated 233 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:36:39.581137 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3055a4-f4e1-4798-ab4c-27e087e95a03 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:39.581648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3055a4-f4e1-4798-ab4c-27e087e95a03 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:39.581721 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3055a4-f4e1-4798-ab4c-27e087e95a03 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:39.583057 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 13/22] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:36:39.600664 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ea87c-f421-400e-9155-b6881202f1ad None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:39.601615 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ea87c-f421-400e-9155-b6881202f1ad None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:39.602261 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ea87c-f421-400e-9155-b6881202f1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:39.623966 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-376ea87c-f421-400e-9155-b6881202f1ad None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:36:39.625552 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-376ea87c-f421-400e-9155-b6881202f1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:36:39.728572 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 10/23] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:36:39.763530 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3055a4-f4e1-4798-ab4c-27e087e95a03 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:39.813996 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60aaba7-dd43-4d3f-bba4-c8086a5996a5 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:39.814671 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60aaba7-dd43-4d3f-bba4-c8086a5996a5 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:39.815189 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60aaba7-dd43-4d3f-bba4-c8086a5996a5 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:39.817386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 11/24] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:36:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:36:39.828669 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68681396-2ac7-4863-bcd7-0291d2391947 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:39.829219 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68681396-2ac7-4863-bcd7-0291d2391947 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:39.829713 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68681396-2ac7-4863-bcd7-0291d2391947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:39.854849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-68681396-2ac7-4863-bcd7-0291d2391947 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:36:39.859147 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-68681396-2ac7-4863-bcd7-0291d2391947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:36:39.903946 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:39.946026 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3055a4-f4e1-4798-ab4c-27e087e95a03 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:39.970334 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 12/25] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:36:39.972128 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ff91a-c2e2-46b3-bb9f-9f67bb9a6709 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:39.972420 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ff91a-c2e2-46b3-bb9f-9f67bb9a6709 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:39.972692 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ff91a-c2e2-46b3-bb9f-9f67bb9a6709 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:39.973949 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 13/26] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:36:39.975022 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9dce4-20e6-48db-929e-35734a685599 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:39.975304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9dce4-20e6-48db-929e-35734a685599 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:39.975578 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9dce4-20e6-48db-929e-35734a685599 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:39.976958 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 14/27] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:36:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:36:39.984851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df3f9c-21fc-4662-b05b-2406aaffb2be None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:39.985133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df3f9c-21fc-4662-b05b-2406aaffb2be None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:39.985406 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df3f9c-21fc-4662-b05b-2406aaffb2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:40.003647 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5113b-26bd-4c3c-a8e9-5bb3ef7f84b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:40.004723 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5113b-26bd-4c3c-a8e9-5bb3ef7f84b1 None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:40.005224 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5113b-26bd-4c3c-a8e9-5bb3ef7f84b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:40.005690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5113b-26bd-4c3c-a8e9-5bb3ef7f84b1 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:40.007455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5113b-26bd-4c3c-a8e9-5bb3ef7f84b1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:40.009418 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5113b-26bd-4c3c-a8e9-5bb3ef7f84b1 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:40.012430 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-a5df3f9c-21fc-4662-b05b-2406aaffb2be None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:36:40.013994 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-a5df3f9c-21fc-4662-b05b-2406aaffb2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:36:40.093653 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 15/28] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:36:40.099224 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabfd64-970e-428a-b2e9-c69670a6b364 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:40.099708 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabfd64-970e-428a-b2e9-c69670a6b364 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:40.100181 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fabfd64-970e-428a-b2e9-c69670a6b364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:40.128439 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-8fabfd64-970e-428a-b2e9-c69670a6b364 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:36:40.129796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-8fabfd64-970e-428a-b2e9-c69670a6b364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:36:40.158649 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 14/29] 10.222.0.57 () {60 vars in 1131 bytes} [Sat Jul 2 20:36:39 2022] POST /identity/v3/roles => generated 219 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:36:40.160213 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5113b-26bd-4c3c-a8e9-5bb3ef7f84b1 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:40.193881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:40.216909 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 16/30] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:36:40.218049 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabfd64-970e-428a-b2e9-c69670a6b364 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:40.238735 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:40.336950 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5113b-26bd-4c3c-a8e9-5bb3ef7f84b1 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:40.415496 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913ca83-15e6-4fff-81ba-912bc66ebebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:40.416802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913ca83-15e6-4fff-81ba-912bc66ebebe None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:40.418040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913ca83-15e6-4fff-81ba-912bc66ebebe None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:40.418485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e913ca83-15e6-4fff-81ba-912bc66ebebe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:40.428059 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fabfd64-970e-428a-b2e9-c69670a6b364 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:40.443686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913ca83-15e6-4fff-81ba-912bc66ebebe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:40.446062 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e913ca83-15e6-4fff-81ba-912bc66ebebe None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:40.470972 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-e913ca83-15e6-4fff-81ba-912bc66ebebe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:36:40.470972 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:36:40.470972 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:36:40.470972 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:36:40.470972 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:36:40.470972 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:36:40.470972 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:36:40.470972 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:36:40.470972 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:36:40.470972 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:36:40.470972 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:36:40.470972 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:36:40.470972 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:36:40.470972 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:36:40.470972 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:36:40.471979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:36:40.471979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:36:40.471979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:36:40.471979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:36:40.471979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:36:40.471979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:36:40.471979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:36:40.471979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:36:40.471979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:36:40.471979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:36:40.471979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:36:40.471979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:36:40.471979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:36:40.471979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:36:40.471979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:36:40.471979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:36:40.471979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:36:40.472958 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:36:40.472958 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:36:40.472958 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:36:40.472958 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:36:40.473197 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2530b5-2c72-408d-a2d8-fa37988cf735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:40.473882 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2530b5-2c72-408d-a2d8-fa37988cf735 None admin] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:40.474345 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2530b5-2c72-408d-a2d8-fa37988cf735 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:40.474794 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2530b5-2c72-408d-a2d8-fa37988cf735 None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:40.475731 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2530b5-2c72-408d-a2d8-fa37988cf735 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:40.477368 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2530b5-2c72-408d-a2d8-fa37988cf735 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:40.479013 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 15/31] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:36:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:36:40.479931 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913ca83-15e6-4fff-81ba-912bc66ebebe None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:40.566995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:40.595007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e913ca83-15e6-4fff-81ba-912bc66ebebe None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:40.630860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed052f-2450-4037-af5c-db888e34af8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:40.631996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed052f-2450-4037-af5c-db888e34af8d None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:40.632469 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed052f-2450-4037-af5c-db888e34af8d None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:40.632893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eed052f-2450-4037-af5c-db888e34af8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:40.637793 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 17/32] 10.222.0.57 () {60 vars in 1131 bytes} [Sat Jul 2 20:36:40 2022] POST /identity/v3/roles => generated 225 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:36:40.638990 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2530b5-2c72-408d-a2d8-fa37988cf735 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:40.646098 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eed052f-2450-4037-af5c-db888e34af8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:36:40.654584 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-0eed052f-2450-4037-af5c-db888e34af8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:36:40.654584 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:36:40.654584 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:36:40.654584 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:36:40.654584 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:36:40.654584 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:36:40.654584 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:36:40.654584 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:36:40.654584 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:36:40.654584 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:36:40.654584 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:36:40.654584 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:36:40.654584 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:36:40.654584 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:36:40.654584 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:36:40.654584 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:36:40.655528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:36:40.655528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:36:40.655528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:36:40.655528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:36:40.655528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:36:40.655528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:36:40.655528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:36:40.655528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:36:40.655528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:36:40.655528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:36:40.655528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:36:40.655528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:36:40.655528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:36:40.655528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:36:40.655528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:36:40.655528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:36:40.656291 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:36:40.656291 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:36:40.656291 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:36:40.656291 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:36:40.656291 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:36:40.656291 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:36:40.656291 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:36:40.656291 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:36:40.656291 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:36:40.656291 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:36:40.656291 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:36:40.656291 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:36:40.659121 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 16/33] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jul 2 20:36:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:36:40.666363 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed052f-2450-4037-af5c-db888e34af8d None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:40.747507 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:40.776732 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2530b5-2c72-408d-a2d8-fa37988cf735 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:40.805659 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eed052f-2450-4037-af5c-db888e34af8d None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:40.819131 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab30399-f537-477b-bf6d-23aa76d37adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:40.820146 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab30399-f537-477b-bf6d-23aa76d37adb None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:40.820601 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab30399-f537-477b-bf6d-23aa76d37adb None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:40.821044 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab30399-f537-477b-bf6d-23aa76d37adb None admin] PATH_INFO: `/v3/domains` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:40.822048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab30399-f537-477b-bf6d-23aa76d37adb None admin] RBAC: Adding query filter params (name=Default) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:36:40.822584 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab30399-f537-477b-bf6d-23aa76d37adb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:40.824347 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab30399-f537-477b-bf6d-23aa76d37adb None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:40.842620 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 18/34] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:40.849656 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab30399-f537-477b-bf6d-23aa76d37adb None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:40.851256 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cceb6-89d8-4201-a172-edcb5327500e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:40.852106 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cceb6-89d8-4201-a172-edcb5327500e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:40.852472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cceb6-89d8-4201-a172-edcb5327500e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:40.852820 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92cceb6-89d8-4201-a172-edcb5327500e None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:40.853701 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cceb6-89d8-4201-a172-edcb5327500e None admin] RBAC: Adding query filter params (name=admin) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:36:40.854198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cceb6-89d8-4201-a172-edcb5327500e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:40.856077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92cceb6-89d8-4201-a172-edcb5327500e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:40.858091 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:40.869202 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 17/35] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:36:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:40.874877 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cceb6-89d8-4201-a172-edcb5327500e None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:40.999480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92cceb6-89d8-4201-a172-edcb5327500e None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:41.045973 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666ae63-819f-4c0a-b617-d223fce7363a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:41.047308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666ae63-819f-4c0a-b617-d223fce7363a None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:41.047789 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666ae63-819f-4c0a-b617-d223fce7363a None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:41.048267 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2666ae63-819f-4c0a-b617-d223fce7363a None admin] PATH_INFO: `/v3/users/a74d0c542d434c4296a1d1b26dca9bac` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:41.050203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666ae63-819f-4c0a-b617-d223fce7363a None admin] RBAC: Authorizing `identity:get_user(user_id=a74d0c542d434c4296a1d1b26dca9bac)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:41.052071 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2666ae63-819f-4c0a-b617-d223fce7363a None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:41.054384 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 18/36] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:36:40 2022] GET /identity/v3/users/a74d0c542d434c4296a1d1b26dca9bac => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:36:41.062456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666ae63-819f-4c0a-b617-d223fce7363a None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:41.063725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab30399-f537-477b-bf6d-23aa76d37adb None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:41.110668 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b0e9a-9572-4ea8-8008-9e2125eef61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:41.111769 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b0e9a-9572-4ea8-8008-9e2125eef61d None admin] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:41.112191 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b0e9a-9572-4ea8-8008-9e2125eef61d None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:41.112604 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b0e9a-9572-4ea8-8008-9e2125eef61d None admin] PATH_INFO: `/v3/projects` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:41.113494 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b0e9a-9572-4ea8-8008-9e2125eef61d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:41.115148 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b0e9a-9572-4ea8-8008-9e2125eef61d None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:41.126185 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:41.139046 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:41.160737 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 19/37] 10.222.0.57 () {60 vars in 1141 bytes} [Sat Jul 2 20:36:40 2022] POST /identity/v3/projects => generated 301 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:36:41.169004 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc730732-d9c7-4b64-9067-c5c81ae1b529 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:41.169518 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc730732-d9c7-4b64-9067-c5c81ae1b529 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:41.169964 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc730732-d9c7-4b64-9067-c5c81ae1b529 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:41.171636 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 20/38] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:36:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:36:41.178039 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d3970-4940-4a24-a461-8cf0795c400e None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:41.178609 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d3970-4940-4a24-a461-8cf0795c400e None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:41.179124 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d3970-4940-4a24-a461-8cf0795c400e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:41.190488 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2666ae63-819f-4c0a-b617-d223fce7363a None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:41.199726 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-af6d3970-4940-4a24-a461-8cf0795c400e None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:36:41.201729 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-af6d3970-4940-4a24-a461-8cf0795c400e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:36:41.233788 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6388a-21cb-4748-a618-f557e943dcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:41.234414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6388a-21cb-4748-a618-f557e943dcb5 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:41.234701 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6388a-21cb-4748-a618-f557e943dcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:41.235013 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd6388a-21cb-4748-a618-f557e943dcb5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:41.236528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6388a-21cb-4748-a618-f557e943dcb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:41.238041 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd6388a-21cb-4748-a618-f557e943dcb5 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:41.240188 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 19/39] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:36:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:41.246325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6388a-21cb-4748-a618-f557e943dcb5 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:41.290571 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 21/40] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:36:41.292276 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d036e49-499a-42b0-9c66-6ff19bdfb187 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:41.292831 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d036e49-499a-42b0-9c66-6ff19bdfb187 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:41.293304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d036e49-499a-42b0-9c66-6ff19bdfb187 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:41.294944 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 22/41] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:36:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:36:41.303163 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38186d6c-1257-443e-9553-4b5dd1737c04 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:41.303788 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38186d6c-1257-443e-9553-4b5dd1737c04 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:41.304259 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38186d6c-1257-443e-9553-4b5dd1737c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:41.325211 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-38186d6c-1257-443e-9553-4b5dd1737c04 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:36:41.326693 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-38186d6c-1257-443e-9553-4b5dd1737c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:36:41.376419 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd6388a-21cb-4748-a618-f557e943dcb5 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:41.403197 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 23/42] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:36:41.404673 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38186d6c-1257-443e-9553-4b5dd1737c04 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:41.419578 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b98704-ad6c-4e72-86ed-65ba6e34385a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:41.421068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b98704-ad6c-4e72-86ed-65ba6e34385a None admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:41.424374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:41.424886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b98704-ad6c-4e72-86ed-65ba6e34385a None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:41.425609 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b98704-ad6c-4e72-86ed-65ba6e34385a None admin] PATH_INFO: `/v3/domains/default/users/a74d0c542d434c4296a1d1b26dca9bac/roles/353a58700c5640988ce2c9012e847cf8` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:41.428824 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b98704-ad6c-4e72-86ed-65ba6e34385a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a74d0c542d434c4296a1d1b26dca9bac, role_id=353a58700c5640988ce2c9012e847cf8)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:41.430546 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b98704-ad6c-4e72-86ed-65ba6e34385a None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:41.450093 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 20/43] 10.222.0.57 () {58 vars in 1361 bytes} [Sat Jul 2 20:36:41 2022] PUT /identity/v3/domains/default/users/a74d0c542d434c4296a1d1b26dca9bac/roles/353a58700c5640988ce2c9012e847cf8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:36:41.451709 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b98704-ad6c-4e72-86ed-65ba6e34385a None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:41.470369 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:41.533243 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38186d6c-1257-443e-9553-4b5dd1737c04 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:41.570355 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb8352-a712-48f3-a1c4-b660d8e8bd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:41.571078 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb8352-a712-48f3-a1c4-b660d8e8bd5a None admin] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:41.571448 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb8352-a712-48f3-a1c4-b660d8e8bd5a None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:41.571739 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb8352-a712-48f3-a1c4-b660d8e8bd5a None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:41.572499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb8352-a712-48f3-a1c4-b660d8e8bd5a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:41.573940 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdb8352-a712-48f3-a1c4-b660d8e8bd5a None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:41.582247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b98704-ad6c-4e72-86ed-65ba6e34385a None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:41.589859 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 24/44] 10.222.0.57 () {60 vars in 1131 bytes} [Sat Jul 2 20:36:41 2022] POST /identity/v3/roles => generated 223 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:36:41.624682 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e7de4-c88e-4bc4-a3d5-d51b06847f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:41.626215 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e7de4-c88e-4bc4-a3d5-d51b06847f8c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:41.626785 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e7de4-c88e-4bc4-a3d5-d51b06847f8c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:41.627364 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e7de4-c88e-4bc4-a3d5-d51b06847f8c None admin] PATH_INFO: `/v3/domains/default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:41.628979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e7de4-c88e-4bc4-a3d5-d51b06847f8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:41.630700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e7de4-c88e-4bc4-a3d5-d51b06847f8c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:41.632728 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 21/45] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:36:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:41.639209 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb8352-a712-48f3-a1c4-b660d8e8bd5a None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:41.763411 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdb8352-a712-48f3-a1c4-b660d8e8bd5a None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:41.775773 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:41.803432 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a376ea-83b4-4dc5-b2fb-08d28923736b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:41.804111 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a376ea-83b4-4dc5-b2fb-08d28923736b None admin] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:41.804393 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a376ea-83b4-4dc5-b2fb-08d28923736b None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:41.804682 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a376ea-83b4-4dc5-b2fb-08d28923736b None admin] PATH_INFO: `/v3/projects` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:41.805400 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a376ea-83b4-4dc5-b2fb-08d28923736b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:41.806853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a376ea-83b4-4dc5-b2fb-08d28923736b None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:41.836277 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 25/46] 10.222.0.57 () {60 vars in 1141 bytes} [Sat Jul 2 20:36:41 2022] POST /identity/v3/projects => generated 312 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:36:43.714478 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a601f79-e9ee-4360-b3fc-a3b8f5087323 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:43.715074 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a601f79-e9ee-4360-b3fc-a3b8f5087323 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:43.715074 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a601f79-e9ee-4360-b3fc-a3b8f5087323 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:43.716581 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 22/47] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:36:43.722134 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b621e-e077-4105-83a3-03ac6f07334b None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:43.722567 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b621e-e077-4105-83a3-03ac6f07334b None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:43.722693 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84b621e-e077-4105-83a3-03ac6f07334b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:43.740362 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-c84b621e-e077-4105-83a3-03ac6f07334b None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:36:43.741569 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-c84b621e-e077-4105-83a3-03ac6f07334b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:36:43.813880 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 26/48] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:36:43.837927 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a601f79-e9ee-4360-b3fc-a3b8f5087323 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:43.904924 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:43.952303 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a601f79-e9ee-4360-b3fc-a3b8f5087323 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:43.987154 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0931026-461d-4148-b8a2-ced00127311b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:43.987874 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0931026-461d-4148-b8a2-ced00127311b None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:43.988154 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0931026-461d-4148-b8a2-ced00127311b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:43.988424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0931026-461d-4148-b8a2-ced00127311b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:43.999003 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0931026-461d-4148-b8a2-ced00127311b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:36:44.006692 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-e0931026-461d-4148-b8a2-ced00127311b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:36:44.006692 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:36:44.006692 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:36:44.006692 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:36:44.006692 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:36:44.006692 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:36:44.006692 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:36:44.006692 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:36:44.006692 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:36:44.006692 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:36:44.006692 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:36:44.006692 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:36:44.006692 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:36:44.006692 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:36:44.006692 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:36:44.006692 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:36:44.007630 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:36:44.007630 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:36:44.007630 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:36:44.007630 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:36:44.007630 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:36:44.007630 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:36:44.007630 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:36:44.007630 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:36:44.007630 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:36:44.007630 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:36:44.007630 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:36:44.007630 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:36:44.007630 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:36:44.007630 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:36:44.007630 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:36:44.007630 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:36:44.008381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:36:44.008381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:36:44.008381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:36:44.008381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:36:44.008381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:36:44.008381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:36:44.008381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:36:44.008381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:36:44.008381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:36:44.008381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:36:44.008381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:36:44.008381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:36:44.008381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 23/49] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jul 2 20:36:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:36:44.015041 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b621e-e077-4105-83a3-03ac6f07334b None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:44.115091 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:44.126042 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84b621e-e077-4105-83a3-03ac6f07334b None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:44.147968 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531f20b-0fef-4aa5-8877-87744b1b3ba5 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:44.148417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531f20b-0fef-4aa5-8877-87744b1b3ba5 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:44.148763 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5531f20b-0fef-4aa5-8877-87744b1b3ba5 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:44.150189 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 24/50] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:36:44.155136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a0830-e122-4687-bba3-154d4c76d896 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:44.155429 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a0830-e122-4687-bba3-154d4c76d896 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:44.155705 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3a0830-e122-4687-bba3-154d4c76d896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:44.160775 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a7230-1507-4f0d-b74b-387b2415e2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:44.161619 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a7230-1507-4f0d-b74b-387b2415e2d6 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:44.162744 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a7230-1507-4f0d-b74b-387b2415e2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:44.163076 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8a7230-1507-4f0d-b74b-387b2415e2d6 None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:44.163853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a7230-1507-4f0d-b74b-387b2415e2d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:36:44.164168 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a7230-1507-4f0d-b74b-387b2415e2d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:44.165588 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8a7230-1507-4f0d-b74b-387b2415e2d6 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:44.172790 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-ef3a0830-e122-4687-bba3-154d4c76d896 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:36:44.174553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-ef3a0830-e122-4687-bba3-154d4c76d896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:36:44.178079 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 27/51] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:36:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:44.183639 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a7230-1507-4f0d-b74b-387b2415e2d6 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:44.242329 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 25/52] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:36:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:36:44.266426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a0830-e122-4687-bba3-154d4c76d896 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:44.294822 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8a7230-1507-4f0d-b74b-387b2415e2d6 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:44.318333 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:44.330607 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a16fe-2217-4df1-8521-7147c0334766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:44.331514 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a16fe-2217-4df1-8521-7147c0334766 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:44.331777 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a16fe-2217-4df1-8521-7147c0334766 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:44.332116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a16fe-2217-4df1-8521-7147c0334766 None admin] PATH_INFO: `/v3/users/a74d0c542d434c4296a1d1b26dca9bac` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:44.333285 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a16fe-2217-4df1-8521-7147c0334766 None admin] RBAC: Authorizing `identity:get_user(user_id=a74d0c542d434c4296a1d1b26dca9bac)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:44.334759 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a16fe-2217-4df1-8521-7147c0334766 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:44.336428 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 28/53] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:36:44 2022] GET /identity/v3/users/a74d0c542d434c4296a1d1b26dca9bac => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:36:44.342611 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a16fe-2217-4df1-8521-7147c0334766 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:44.369023 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:44.379612 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3a0830-e122-4687-bba3-154d4c76d896 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:44.414689 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a42866-89cd-491a-8f19-1edaf85b129f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:44.415548 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a42866-89cd-491a-8f19-1edaf85b129f None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:44.415834 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a42866-89cd-491a-8f19-1edaf85b129f None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:44.416104 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a42866-89cd-491a-8f19-1edaf85b129f None admin] PATH_INFO: `/v3/domains/default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:44.417312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a42866-89cd-491a-8f19-1edaf85b129f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:44.418775 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a42866-89cd-491a-8f19-1edaf85b129f None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:44.420410 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 26/54] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:36:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:36:44.427444 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a42866-89cd-491a-8f19-1edaf85b129f None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:44.446580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a16fe-2217-4df1-8521-7147c0334766 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:44.480331 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7d3d8-84ed-4b88-81a1-f1130ee4c132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:44.481101 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7d3d8-84ed-4b88-81a1-f1130ee4c132 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:44.481376 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7d3d8-84ed-4b88-81a1-f1130ee4c132 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:44.481646 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7d3d8-84ed-4b88-81a1-f1130ee4c132 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:44.482998 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7d3d8-84ed-4b88-81a1-f1130ee4c132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:44.484494 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7d3d8-84ed-4b88-81a1-f1130ee4c132 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:44.486398 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 29/55] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:36:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:44.492567 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7d3d8-84ed-4b88-81a1-f1130ee4c132 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:44.528819 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a42866-89cd-491a-8f19-1edaf85b129f None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:44.546620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:44.564810 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe64f25-eaa5-4345-8bb9-06c3940dd9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:44.565505 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe64f25-eaa5-4345-8bb9-06c3940dd9bd None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:44.565794 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe64f25-eaa5-4345-8bb9-06c3940dd9bd None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:44.566081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe64f25-eaa5-4345-8bb9-06c3940dd9bd None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:44.566817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe64f25-eaa5-4345-8bb9-06c3940dd9bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:44.568405 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe64f25-eaa5-4345-8bb9-06c3940dd9bd None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:44.583416 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:44.594665 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7d3d8-84ed-4b88-81a1-f1130ee4c132 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:44.596561 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 27/56] 10.222.0.57 () {60 vars in 1140 bytes} [Sat Jul 2 20:36:44 2022] POST /identity/v3/projects => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 20:36:44.642594 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb79a59-b71d-4108-90b3-380f6280a52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:44.643618 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb79a59-b71d-4108-90b3-380f6280a52a None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:44.643906 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb79a59-b71d-4108-90b3-380f6280a52a None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:44.644180 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb79a59-b71d-4108-90b3-380f6280a52a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:44.645029 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb79a59-b71d-4108-90b3-380f6280a52a None admin] RBAC: Adding query filter params (role.id=353a58700c5640988ce2c9012e847cf8, scope.domain.id=default, user.id=a74d0c542d434c4296a1d1b26dca9bac) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:36:44.645340 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb79a59-b71d-4108-90b3-380f6280a52a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:44.646832 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb79a59-b71d-4108-90b3-380f6280a52a None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:44.653798 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 30/57] 10.222.0.57 () {56 vars in 1322 bytes} [Sat Jul 2 20:36:44 2022] GET /identity/v3/role_assignments?user.id=a74d0c542d434c4296a1d1b26dca9bac&scope.domain.id=default&role.id=353a58700c5640988ce2c9012e847cf8 => generated 530 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:36:46.894860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d93a7-5094-403a-a906-d6add8147103 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:46.895799 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d93a7-5094-403a-a906-d6add8147103 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:46.895799 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462d93a7-5094-403a-a906-d6add8147103 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:46.898014 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 28/58] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:36:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:36:46.904196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f45999-3d84-4da9-b45a-771f1f6e14f6 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:46.904617 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f45999-3d84-4da9-b45a-771f1f6e14f6 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:46.904800 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f45999-3d84-4da9-b45a-771f1f6e14f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:46.924492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-b0f45999-3d84-4da9-b45a-771f1f6e14f6 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:36:46.925757 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-b0f45999-3d84-4da9-b45a-771f1f6e14f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:36:47.007473 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 31/59] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:36:47.033906 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d93a7-5094-403a-a906-d6add8147103 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:47.151430 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462d93a7-5094-403a-a906-d6add8147103 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:47.186098 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0c012a-5c62-4b6e-bb86-80d239399a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:47.186895 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c012a-5c62-4b6e-bb86-80d239399a90 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:47.187223 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c012a-5c62-4b6e-bb86-80d239399a90 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:47.187496 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0c012a-5c62-4b6e-bb86-80d239399a90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:47.188781 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c012a-5c62-4b6e-bb86-80d239399a90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:47.190289 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0c012a-5c62-4b6e-bb86-80d239399a90 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:47.191915 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 29/60] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:36:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:47.198173 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f45999-3d84-4da9-b45a-771f1f6e14f6 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:47.296528 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:47.314733 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f45999-3d84-4da9-b45a-771f1f6e14f6 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:47.358685 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fde75d4-cdcd-4de1-9776-4cf69ea3dbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:47.359392 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde75d4-cdcd-4de1-9776-4cf69ea3dbc0 None admin] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:47.359676 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde75d4-cdcd-4de1-9776-4cf69ea3dbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:47.359949 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fde75d4-cdcd-4de1-9776-4cf69ea3dbc0 None admin] PATH_INFO: `/v3/users` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:47.360661 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde75d4-cdcd-4de1-9776-4cf69ea3dbc0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:47.362513 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fde75d4-cdcd-4de1-9776-4cf69ea3dbc0 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:47.393592 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 32/61] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jul 2 20:36:47 2022] POST /identity/v3/users => generated 275 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:36:51.127426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77740f-1759-4513-b7f3-3ac57bdbe689 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:51.127426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77740f-1759-4513-b7f3-3ac57bdbe689 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:51.128045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b77740f-1759-4513-b7f3-3ac57bdbe689 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:51.129273 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 30/62] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:36:51.134475 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9335a-bf77-4e80-b11b-33e5a1898f74 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:51.134892 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9335a-bf77-4e80-b11b-33e5a1898f74 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:51.135089 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9335a-bf77-4e80-b11b-33e5a1898f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:51.152718 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-37f9335a-bf77-4e80-b11b-33e5a1898f74 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:36:51.153916 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-37f9335a-bf77-4e80-b11b-33e5a1898f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:36:51.170288 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50453459-7f20-48c2-b724-e789c45df76a None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:51.170596 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50453459-7f20-48c2-b724-e789c45df76a None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:51.170845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50453459-7f20-48c2-b724-e789c45df76a None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:51.172520 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 31/63] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:36:51.182030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2e351-6f6b-48b5-944d-2936b791392e None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:51.182337 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2e351-6f6b-48b5-944d-2936b791392e None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:51.182583 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2e351-6f6b-48b5-944d-2936b791392e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:51.206707 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-f0c2e351-6f6b-48b5-944d-2936b791392e None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:36:51.208158 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-f0c2e351-6f6b-48b5-944d-2936b791392e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:36:51.271288 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:51.280670 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 33/64] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:36:51.309260 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9335a-bf77-4e80-b11b-33e5a1898f74 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:51.344207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 32/65] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:36:51.345893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d9c2e-47e7-4c88-9002-b83227736441 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:51.346416 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d9c2e-47e7-4c88-9002-b83227736441 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:51.346602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d9c2e-47e7-4c88-9002-b83227736441 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:51.348393 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 33/66] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:36:51.354049 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6926865-9a4e-442f-894d-018511610b02 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:51.354402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6926865-9a4e-442f-894d-018511610b02 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:51.354742 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6926865-9a4e-442f-894d-018511610b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:51.373865 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-e6926865-9a4e-442f-894d-018511610b02 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:36:51.375214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-e6926865-9a4e-442f-894d-018511610b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:36:51.404480 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:51.439614 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9335a-bf77-4e80-b11b-33e5a1898f74 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:51.461027 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 34/67] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:36:51.467473 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6926865-9a4e-442f-894d-018511610b02 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:51.483791 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c700b-07b4-4930-9c59-1ed34a9b42d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:51.485209 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c700b-07b4-4930-9c59-1ed34a9b42d7 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:51.485716 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c700b-07b4-4930-9c59-1ed34a9b42d7 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:51.486059 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c700b-07b4-4930-9c59-1ed34a9b42d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:51.498004 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c700b-07b4-4930-9c59-1ed34a9b42d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:36:51.507243 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-581c700b-07b4-4930-9c59-1ed34a9b42d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:36:51.507243 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:36:51.507243 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:36:51.507243 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:36:51.507243 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:36:51.507243 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:36:51.507243 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:36:51.507243 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:36:51.507243 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:36:51.507243 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:36:51.507243 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:36:51.507243 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:36:51.507243 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:36:51.507243 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:36:51.507243 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:36:51.507243 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:36:51.508081 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:36:51.508081 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:36:51.508081 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:36:51.508081 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:36:51.508081 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:36:51.508081 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:36:51.508081 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:36:51.508081 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:36:51.508081 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:36:51.508081 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:36:51.508081 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:36:51.508081 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:36:51.508081 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:36:51.508081 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:36:51.508081 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:36:51.508081 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:36:51.508831 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:36:51.508831 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:36:51.508831 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:36:51.508831 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:36:51.508831 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:36:51.508831 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:36:51.508831 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:36:51.508831 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:36:51.508831 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:36:51.508831 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:36:51.508831 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:36:51.508831 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:36:51.508831 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 34/68] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jul 2 20:36:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:36:51.510232 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82dbf2-6d4d-48a6-945c-6633ee80cea3 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:51.510232 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82dbf2-6d4d-48a6-945c-6633ee80cea3 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:51.510232 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82dbf2-6d4d-48a6-945c-6633ee80cea3 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:51.513264 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 35/69] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:36:51.514340 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82dbf2-6d4d-48a6-945c-6633ee80cea3 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:51.570518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:51.574006 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6926865-9a4e-442f-894d-018511610b02 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:51.609932 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a0036-1db3-4eb3-8fc1-e4543ca2230e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:51.610751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a0036-1db3-4eb3-8fc1-e4543ca2230e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:51.611574 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a0036-1db3-4eb3-8fc1-e4543ca2230e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:51.611866 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a0036-1db3-4eb3-8fc1-e4543ca2230e None admin] PATH_INFO: `/v3/roles/member` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:51.619091 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82dbf2-6d4d-48a6-945c-6633ee80cea3 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:51.622153 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a0036-1db3-4eb3-8fc1-e4543ca2230e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:36:51.630452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-3d1a0036-1db3-4eb3-8fc1-e4543ca2230e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:36:51.630452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:36:51.630452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:36:51.630452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:36:51.630452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:36:51.630452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:36:51.630452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:36:51.630452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:36:51.630452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:36:51.630452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:36:51.630452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:36:51.630452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:36:51.630452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:36:51.630452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:36:51.630452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:36:51.630452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:36:51.631313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:36:51.631313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:36:51.631313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:36:51.631313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:36:51.631313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:36:51.631313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:36:51.631313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:36:51.631313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:36:51.631313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:36:51.631313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:36:51.631313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:36:51.631313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:36:51.631313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:36:51.631313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:36:51.631313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:36:51.631313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:36:51.632096 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:36:51.632096 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:36:51.632096 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:36:51.632096 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:36:51.632096 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:36:51.632096 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:36:51.632096 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:36:51.632096 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:36:51.632096 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:36:51.632096 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:36:51.632096 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:36:51.632096 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:36:51.632655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 35/70] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:36:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:36:51.633491 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a0036-1db3-4eb3-8fc1-e4543ca2230e None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:51.653862 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:51.660486 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5839d81e-2652-4e02-a12e-f71daa4fe887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:51.661240 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839d81e-2652-4e02-a12e-f71daa4fe887 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:51.661527 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839d81e-2652-4e02-a12e-f71daa4fe887 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:51.661799 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5839d81e-2652-4e02-a12e-f71daa4fe887 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:51.672430 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5839d81e-2652-4e02-a12e-f71daa4fe887 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:36:51.681210 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-5839d81e-2652-4e02-a12e-f71daa4fe887 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:36:51.681210 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:36:51.681210 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:36:51.681210 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:36:51.681210 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:36:51.681210 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:36:51.681210 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:36:51.681210 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:36:51.681210 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:36:51.681210 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:36:51.681210 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:36:51.681210 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:36:51.681210 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:36:51.681210 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:36:51.681210 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:36:51.681210 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:36:51.682133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:36:51.682133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:36:51.682133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:36:51.682133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:36:51.682133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:36:51.682133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:36:51.682133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:36:51.682133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:36:51.682133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:36:51.682133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:36:51.682133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:36:51.682133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:36:51.682133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:36:51.682133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:36:51.682133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:36:51.682133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:36:51.682895 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:36:51.682895 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:36:51.682895 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:36:51.682895 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:36:51.682895 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:36:51.682895 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:36:51.682895 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:36:51.682895 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:36:51.682895 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:36:51.682895 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:36:51.682895 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:36:51.682895 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:36:51.682895 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 36/71] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jul 2 20:36:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:36:51.683718 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce66d65-a9bc-4859-a65e-87e55fc42750 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:51.684072 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce66d65-a9bc-4859-a65e-87e55fc42750 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:51.684260 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce66d65-a9bc-4859-a65e-87e55fc42750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:51.702087 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-fce66d65-a9bc-4859-a65e-87e55fc42750 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:36:51.703623 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-fce66d65-a9bc-4859-a65e-87e55fc42750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:36:51.749056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a0036-1db3-4eb3-8fc1-e4543ca2230e None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:51.772047 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 37/72] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:36:51.773555 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f3659-b145-4fbc-9667-022da7fd501d None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:51.773848 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f3659-b145-4fbc-9667-022da7fd501d None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:51.774125 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f3659-b145-4fbc-9667-022da7fd501d None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:51.775584 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 38/73] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:36:51.780195 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f3659-b145-4fbc-9667-022da7fd501d None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:51.784399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c0b93-ca7b-4a06-ab5e-d2eb7d657e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:51.785073 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c0b93-ca7b-4a06-ab5e-d2eb7d657e98 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:51.785356 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c0b93-ca7b-4a06-ab5e-d2eb7d657e98 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:51.785629 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c0b93-ca7b-4a06-ab5e-d2eb7d657e98 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:51.786375 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c0b93-ca7b-4a06-ab5e-d2eb7d657e98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:36:51.786683 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c0b93-ca7b-4a06-ab5e-d2eb7d657e98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:51.788132 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c0b93-ca7b-4a06-ab5e-d2eb7d657e98 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:51.796440 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 36/74] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:36:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:51.797245 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c0b93-ca7b-4a06-ab5e-d2eb7d657e98 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:51.819820 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:51.893608 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f3659-b145-4fbc-9667-022da7fd501d None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:51.899670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c0b93-ca7b-4a06-ab5e-d2eb7d657e98 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:51.913865 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:51.928690 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e62e7d-edc8-4b9c-a217-0d7af7d0a547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:51.929376 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e62e7d-edc8-4b9c-a217-0d7af7d0a547 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:51.929658 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e62e7d-edc8-4b9c-a217-0d7af7d0a547 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:51.930089 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e62e7d-edc8-4b9c-a217-0d7af7d0a547 None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:51.930718 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e62e7d-edc8-4b9c-a217-0d7af7d0a547 None admin] RBAC: Adding query filter params (name=member) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:36:51.931055 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e62e7d-edc8-4b9c-a217-0d7af7d0a547 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:51.932455 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e62e7d-edc8-4b9c-a217-0d7af7d0a547 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:51.934631 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470769d-a342-49d0-b453-8bd4d4ab8150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:51.935339 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470769d-a342-49d0-b453-8bd4d4ab8150 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:51.935626 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470769d-a342-49d0-b453-8bd4d4ab8150 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:51.935903 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470769d-a342-49d0-b453-8bd4d4ab8150 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:51.936642 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470769d-a342-49d0-b453-8bd4d4ab8150 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:36:51.936952 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470769d-a342-49d0-b453-8bd4d4ab8150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:51.938334 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b470769d-a342-49d0-b453-8bd4d4ab8150 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:51.940706 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 39/75] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:36:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:51.941882 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d875848-ee1f-48bd-93da-7abb2d2675c5 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:51.942170 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d875848-ee1f-48bd-93da-7abb2d2675c5 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:51.942444 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d875848-ee1f-48bd-93da-7abb2d2675c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:51.951324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 37/76] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:36:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:51.952160 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470769d-a342-49d0-b453-8bd4d4ab8150 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:51.958891 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-6d875848-ee1f-48bd-93da-7abb2d2675c5 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:36:51.960115 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-6d875848-ee1f-48bd-93da-7abb2d2675c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:36:52.025765 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 40/77] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:36:52.031820 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d875848-ee1f-48bd-93da-7abb2d2675c5 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:52.037254 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:52.057414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470769d-a342-49d0-b453-8bd4d4ab8150 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:52.091792 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a2e0c-1944-4953-aeb7-f28b607b9250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:52.092594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a2e0c-1944-4953-aeb7-f28b607b9250 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:52.092868 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a2e0c-1944-4953-aeb7-f28b607b9250 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:52.093142 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a2e0c-1944-4953-aeb7-f28b607b9250 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:52.094350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a2e0c-1944-4953-aeb7-f28b607b9250 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:52.096100 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a2e0c-1944-4953-aeb7-f28b607b9250 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:52.097724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 38/78] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:36:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:52.098483 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a2e0c-1944-4953-aeb7-f28b607b9250 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:52.137813 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d875848-ee1f-48bd-93da-7abb2d2675c5 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:52.150641 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:52.172183 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f5a38-28ee-44ce-9e97-ed62c71c68af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:52.172990 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f5a38-28ee-44ce-9e97-ed62c71c68af None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:52.173317 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f5a38-28ee-44ce-9e97-ed62c71c68af None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:52.173695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f5a38-28ee-44ce-9e97-ed62c71c68af None admin] PATH_INFO: `/v3/users/a74d0c542d434c4296a1d1b26dca9bac` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:52.174920 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f5a38-28ee-44ce-9e97-ed62c71c68af None admin] RBAC: Authorizing `identity:get_user(user_id=a74d0c542d434c4296a1d1b26dca9bac)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:52.176403 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f5a38-28ee-44ce-9e97-ed62c71c68af None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:52.178030 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 41/79] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:36:52 2022] GET /identity/v3/users/a74d0c542d434c4296a1d1b26dca9bac => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:52.178787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f5a38-28ee-44ce-9e97-ed62c71c68af None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:52.200674 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a2e0c-1944-4953-aeb7-f28b607b9250 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:52.240449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ee4cd-7170-48c8-9b5a-98f148cace36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:52.241363 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ee4cd-7170-48c8-9b5a-98f148cace36 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:52.241654 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ee4cd-7170-48c8-9b5a-98f148cace36 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:52.241936 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ee4cd-7170-48c8-9b5a-98f148cace36 None admin] PATH_INFO: `/v3/users/10854b3b3c7d41e986054d0f542ffe6e` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:52.257404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ee4cd-7170-48c8-9b5a-98f148cace36 None admin] RBAC: Authorizing `identity:get_user(user_id=10854b3b3c7d41e986054d0f542ffe6e)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:52.258871 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ee4cd-7170-48c8-9b5a-98f148cace36 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:52.260605 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 39/80] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:36:52 2022] GET /identity/v3/users/10854b3b3c7d41e986054d0f542ffe6e => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:52.261375 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ee4cd-7170-48c8-9b5a-98f148cace36 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:52.273607 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:52.278427 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f5a38-28ee-44ce-9e97-ed62c71c68af None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:52.312412 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3421b8d-b8bb-42fe-bff1-f7a9308e7792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:52.313301 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3421b8d-b8bb-42fe-bff1-f7a9308e7792 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:52.313589 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3421b8d-b8bb-42fe-bff1-f7a9308e7792 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:52.313878 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3421b8d-b8bb-42fe-bff1-f7a9308e7792 None admin] PATH_INFO: `/v3/users/10854b3b3c7d41e986054d0f542ffe6e` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:52.315136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3421b8d-b8bb-42fe-bff1-f7a9308e7792 None admin] RBAC: Authorizing `identity:get_user(user_id=10854b3b3c7d41e986054d0f542ffe6e)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:52.316628 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3421b8d-b8bb-42fe-bff1-f7a9308e7792 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:52.318279 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 42/81] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:36:52 2022] GET /identity/v3/users/10854b3b3c7d41e986054d0f542ffe6e => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:52.319083 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3421b8d-b8bb-42fe-bff1-f7a9308e7792 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:52.362632 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ee4cd-7170-48c8-9b5a-98f148cace36 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:52.367931 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:52.395947 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b96a9-de9c-4f12-88df-45260c60892f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:52.396791 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b96a9-de9c-4f12-88df-45260c60892f None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:52.397078 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b96a9-de9c-4f12-88df-45260c60892f None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:52.397355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b96a9-de9c-4f12-88df-45260c60892f None admin] PATH_INFO: `/v3/roles/member` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:52.407315 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b96a9-de9c-4f12-88df-45260c60892f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:36:52.415214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-681b96a9-de9c-4f12-88df-45260c60892f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:36:52.415214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:36:52.415214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:36:52.415214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:36:52.415214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:36:52.415214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:36:52.415214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:36:52.415214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:36:52.415214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:36:52.415214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:36:52.415214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:36:52.415214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:36:52.415214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:36:52.415214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:36:52.415214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:36:52.415214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:36:52.416110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:36:52.416110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:36:52.416110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:36:52.416110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:36:52.416110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:36:52.416110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:36:52.416110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:36:52.416110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:36:52.416110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:36:52.416110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:36:52.416110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:36:52.416110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:36:52.416110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:36:52.416110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:36:52.416110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:36:52.416110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:36:52.416875 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:36:52.416875 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:36:52.416875 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:36:52.416875 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:36:52.416875 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:36:52.416875 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:36:52.416875 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:36:52.416875 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:36:52.416875 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:36:52.416875 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:36:52.416875 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:36:52.416875 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:36:52.416875 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 40/82] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:36:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:36:52.417526 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b96a9-de9c-4f12-88df-45260c60892f None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:52.418169 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3421b8d-b8bb-42fe-bff1-f7a9308e7792 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:52.455859 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25347c6d-5c48-4c0c-90c0-1199705bb1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:52.456455 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25347c6d-5c48-4c0c-90c0-1199705bb1de None admin] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:52.456741 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25347c6d-5c48-4c0c-90c0-1199705bb1de None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:52.457023 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25347c6d-5c48-4c0c-90c0-1199705bb1de None admin] PATH_INFO: `/v3/users` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:52.457758 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25347c6d-5c48-4c0c-90c0-1199705bb1de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:52.459297 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25347c6d-5c48-4c0c-90c0-1199705bb1de None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:52.480139 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 43/83] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jul 2 20:36:52 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:36:52.485272 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:52.492017 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25347c6d-5c48-4c0c-90c0-1199705bb1de None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:52.526833 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b96a9-de9c-4f12-88df-45260c60892f None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:52.567126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1949f-36a8-47b8-9d4e-64ad8eb00f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:52.567811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1949f-36a8-47b8-9d4e-64ad8eb00f0a None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:52.568097 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1949f-36a8-47b8-9d4e-64ad8eb00f0a None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:52.568377 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1949f-36a8-47b8-9d4e-64ad8eb00f0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:52.611327 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25347c6d-5c48-4c0c-90c0-1199705bb1de None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:52.613933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:52.650930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1949f-36a8-47b8-9d4e-64ad8eb00f0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:52.652501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1949f-36a8-47b8-9d4e-64ad8eb00f0a None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:52.654484 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45226a51-6d25-4b36-afe2-5795f741ba33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:52.655310 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45226a51-6d25-4b36-afe2-5795f741ba33 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:52.655594 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45226a51-6d25-4b36-afe2-5795f741ba33 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:52.655878 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45226a51-6d25-4b36-afe2-5795f741ba33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:52.735543 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:52.743186 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45226a51-6d25-4b36-afe2-5795f741ba33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:52.744725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45226a51-6d25-4b36-afe2-5795f741ba33 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:52.777801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 41/84] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:36:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:36:52.778841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1949f-36a8-47b8-9d4e-64ad8eb00f0a None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:52.868699 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 44/85] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:36:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:36:52.869688 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45226a51-6d25-4b36-afe2-5795f741ba33 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:52.873486 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:52.910060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1949f-36a8-47b8-9d4e-64ad8eb00f0a None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:52.947747 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea9ab3-3631-401c-870c-1e3cbd660a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:52.948871 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea9ab3-3631-401c-870c-1e3cbd660a7e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:52.949332 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea9ab3-3631-401c-870c-1e3cbd660a7e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:52.949831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aea9ab3-3631-401c-870c-1e3cbd660a7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:52.986844 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:52.999323 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45226a51-6d25-4b36-afe2-5795f741ba33 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:53.028021 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea9ab3-3631-401c-870c-1e3cbd660a7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:53.029982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aea9ab3-3631-401c-870c-1e3cbd660a7e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:53.042310 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866c53b-33e0-4046-b583-3f0cceb557fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:53.043467 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866c53b-33e0-4046-b583-3f0cceb557fb None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:53.043942 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866c53b-33e0-4046-b583-3f0cceb557fb None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:53.044560 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866c53b-33e0-4046-b583-3f0cceb557fb None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:53.045625 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866c53b-33e0-4046-b583-3f0cceb557fb None admin] RBAC: Adding query filter params (name=member) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:36:53.046103 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866c53b-33e0-4046-b583-3f0cceb557fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:53.047861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866c53b-33e0-4046-b583-3f0cceb557fb None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:53.057748 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 45/86] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:36:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:53.059016 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866c53b-33e0-4046-b583-3f0cceb557fb None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:53.147687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:53.148385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 42/87] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:36:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:36:53.150041 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea9ab3-3631-401c-870c-1e3cbd660a7e None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:53.192494 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866c53b-33e0-4046-b583-3f0cceb557fb None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:53.223089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:53.241918 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6960d-3863-4390-9b3a-3d6c8db935f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:53.243385 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6960d-3863-4390-9b3a-3d6c8db935f8 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:53.243935 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6960d-3863-4390-9b3a-3d6c8db935f8 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:53.244344 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d6960d-3863-4390-9b3a-3d6c8db935f8 None admin] PATH_INFO: `/v3/projects/17380892ecb2424e932154c8ad8864b7` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:53.245603 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6960d-3863-4390-9b3a-3d6c8db935f8 None admin] RBAC: Authorizing `identity:get_project(project_id=17380892ecb2424e932154c8ad8864b7)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:53.248027 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d6960d-3863-4390-9b3a-3d6c8db935f8 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:53.250257 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 46/88] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:36:53 2022] GET /identity/v3/projects/17380892ecb2424e932154c8ad8864b7 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:53.251654 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6960d-3863-4390-9b3a-3d6c8db935f8 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:53.272369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aea9ab3-3631-401c-870c-1e3cbd660a7e None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:53.309255 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7f343-3c0d-4650-893a-7c941dfcfc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:53.310169 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7f343-3c0d-4650-893a-7c941dfcfc6c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:53.310453 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7f343-3c0d-4650-893a-7c941dfcfc6c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:53.310730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7f343-3c0d-4650-893a-7c941dfcfc6c None admin] PATH_INFO: `/v3/projects/17380892ecb2424e932154c8ad8864b7` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:53.311978 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7f343-3c0d-4650-893a-7c941dfcfc6c None admin] RBAC: Authorizing `identity:get_project(project_id=17380892ecb2424e932154c8ad8864b7)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:53.313485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7f343-3c0d-4650-893a-7c941dfcfc6c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:53.315465 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 43/89] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:36:53 2022] GET /identity/v3/projects/17380892ecb2424e932154c8ad8864b7 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:53.316377 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7f343-3c0d-4650-893a-7c941dfcfc6c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:53.382492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d6960d-3863-4390-9b3a-3d6c8db935f8 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:53.418484 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f2fff-2263-405b-8523-08b34278f73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:53.419415 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f2fff-2263-405b-8523-08b34278f73a None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:53.419690 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f2fff-2263-405b-8523-08b34278f73a None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:53.419965 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f2fff-2263-405b-8523-08b34278f73a None admin] PATH_INFO: `/v3/users/10854b3b3c7d41e986054d0f542ffe6e` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:53.421203 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f2fff-2263-405b-8523-08b34278f73a None admin] RBAC: Authorizing `identity:get_user(user_id=10854b3b3c7d41e986054d0f542ffe6e)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:53.422666 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f2fff-2263-405b-8523-08b34278f73a None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:53.423924 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7f343-3c0d-4650-893a-7c941dfcfc6c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:53.424395 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 47/90] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:36:53 2022] GET /identity/v3/users/10854b3b3c7d41e986054d0f542ffe6e => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:53.425174 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f2fff-2263-405b-8523-08b34278f73a None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:53.432305 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:53.464309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601eca46-a226-46c4-8a56-47f56161e9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:53.465622 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601eca46-a226-46c4-8a56-47f56161e9ab None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:53.466043 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601eca46-a226-46c4-8a56-47f56161e9ab None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:53.466329 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601eca46-a226-46c4-8a56-47f56161e9ab None admin] PATH_INFO: `/v3/projects/17380892ecb2424e932154c8ad8864b7` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:53.467593 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601eca46-a226-46c4-8a56-47f56161e9ab None admin] RBAC: Authorizing `identity:get_project(project_id=17380892ecb2424e932154c8ad8864b7)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:53.470409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601eca46-a226-46c4-8a56-47f56161e9ab None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:53.472436 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 44/91] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:36:53 2022] GET /identity/v3/projects/17380892ecb2424e932154c8ad8864b7 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:53.473348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601eca46-a226-46c4-8a56-47f56161e9ab None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:53.478332 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:53.554473 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f2fff-2263-405b-8523-08b34278f73a None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:53.598124 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601eca46-a226-46c4-8a56-47f56161e9ab None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:53.600256 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9b9b4-3767-49ee-b565-ca62cd2d4450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:53.601128 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9b9b4-3767-49ee-b565-ca62cd2d4450 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:53.601564 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9b9b4-3767-49ee-b565-ca62cd2d4450 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:53.601993 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a9b9b4-3767-49ee-b565-ca62cd2d4450 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:53.603003 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a9b9b4-3767-49ee-b565-ca62cd2d4450 None admin] RBAC: Adding query filter params (role.id=353a58700c5640988ce2c9012e847cf8, scope.project.id=17380892ecb2424e932154c8ad8864b7, user.id=a74d0c542d434c4296a1d1b26dca9bac) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:36:53.603479 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a9b9b4-3767-49ee-b565-ca62cd2d4450 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:53.605183 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a9b9b4-3767-49ee-b565-ca62cd2d4450 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:53.611539 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 48/92] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:36:53 2022] GET /identity/v3/role_assignments?user.id=a74d0c542d434c4296a1d1b26dca9bac&scope.project.id=17380892ecb2424e932154c8ad8864b7&role.id=353a58700c5640988ce2c9012e847cf8 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:53.612626 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9b9b4-3767-49ee-b565-ca62cd2d4450 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:53.647431 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033053a-2b60-4f86-ae6b-9bd3e530045c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:53.648641 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033053a-2b60-4f86-ae6b-9bd3e530045c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:53.648939 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033053a-2b60-4f86-ae6b-9bd3e530045c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:53.649220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033053a-2b60-4f86-ae6b-9bd3e530045c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:53.650429 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033053a-2b60-4f86-ae6b-9bd3e530045c None admin] RBAC: Adding query filter params (role.id=538580824ccd4e02823540ee3df31cdc, scope.project.id=17380892ecb2424e932154c8ad8864b7, user.id=10854b3b3c7d41e986054d0f542ffe6e) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:36:53.650750 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033053a-2b60-4f86-ae6b-9bd3e530045c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:53.652641 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033053a-2b60-4f86-ae6b-9bd3e530045c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:53.666095 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 45/93] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:36:53 2022] GET /identity/v3/role_assignments?user.id=10854b3b3c7d41e986054d0f542ffe6e&scope.project.id=17380892ecb2424e932154c8ad8864b7&role.id=538580824ccd4e02823540ee3df31cdc => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:53.667716 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033053a-2b60-4f86-ae6b-9bd3e530045c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:53.708286 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:53.761928 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:53.777325 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a9b9b4-3767-49ee-b565-ca62cd2d4450 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:53.809149 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033053a-2b60-4f86-ae6b-9bd3e530045c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:53.821757 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78315ed0-147b-42fd-9e1d-9b59b325c823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:53.822838 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78315ed0-147b-42fd-9e1d-9b59b325c823 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:53.823373 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78315ed0-147b-42fd-9e1d-9b59b325c823 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:53.823855 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78315ed0-147b-42fd-9e1d-9b59b325c823 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:53.850411 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efad36-8a68-46f8-9eb3-b2183bc3d28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:53.851120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efad36-8a68-46f8-9eb3-b2183bc3d28e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:53.851412 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efad36-8a68-46f8-9eb3-b2183bc3d28e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:53.851694 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84efad36-8a68-46f8-9eb3-b2183bc3d28e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:53.852622 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84efad36-8a68-46f8-9eb3-b2183bc3d28e None admin] RBAC: Adding query filter params (role.id=a03f493abb6846eebc4958aabe8b28ad, scope.project.id=17380892ecb2424e932154c8ad8864b7, user.id=10854b3b3c7d41e986054d0f542ffe6e) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:36:53.852945 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84efad36-8a68-46f8-9eb3-b2183bc3d28e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:53.855058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84efad36-8a68-46f8-9eb3-b2183bc3d28e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:53.861676 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 46/94] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:36:53 2022] GET /identity/v3/role_assignments?user.id=10854b3b3c7d41e986054d0f542ffe6e&scope.project.id=17380892ecb2424e932154c8ad8864b7&role.id=a03f493abb6846eebc4958aabe8b28ad => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:53.916616 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78315ed0-147b-42fd-9e1d-9b59b325c823 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:53.918682 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78315ed0-147b-42fd-9e1d-9b59b325c823 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:54.018676 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:54.066386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 49/95] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:36:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:36:54.072186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efad36-8a68-46f8-9eb3-b2183bc3d28e None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:54.200552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84efad36-8a68-46f8-9eb3-b2183bc3d28e None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:54.238993 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:54.248083 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3f57f-b775-4cc2-b79d-38cba33162b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:54.248999 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3f57f-b775-4cc2-b79d-38cba33162b6 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:54.249322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3f57f-b775-4cc2-b79d-38cba33162b6 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:54.249662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3f57f-b775-4cc2-b79d-38cba33162b6 None admin] PATH_INFO: `/v3/projects/1d43cdebf69c4cedabe6fc514bb04524` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:54.251027 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3f57f-b775-4cc2-b79d-38cba33162b6 None admin] RBAC: Authorizing `identity:get_project(project_id=1d43cdebf69c4cedabe6fc514bb04524)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:54.252728 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3f57f-b775-4cc2-b79d-38cba33162b6 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:54.255452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 47/96] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:36:54 2022] GET /identity/v3/projects/1d43cdebf69c4cedabe6fc514bb04524 => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:54.261134 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78315ed0-147b-42fd-9e1d-9b59b325c823 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:54.419461 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78315ed0-147b-42fd-9e1d-9b59b325c823 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:54.459238 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62efc2-02d4-4fc4-82f6-b4439694e064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:54.460294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62efc2-02d4-4fc4-82f6-b4439694e064 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:54.460785 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62efc2-02d4-4fc4-82f6-b4439694e064 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:54.461300 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62efc2-02d4-4fc4-82f6-b4439694e064 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:54.462326 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62efc2-02d4-4fc4-82f6-b4439694e064 None admin] RBAC: Adding query filter params (role.id=538580824ccd4e02823540ee3df31cdc, scope.project.id=1d43cdebf69c4cedabe6fc514bb04524, user.id=10854b3b3c7d41e986054d0f542ffe6e) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:36:54.462844 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62efc2-02d4-4fc4-82f6-b4439694e064 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:54.464556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62efc2-02d4-4fc4-82f6-b4439694e064 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:54.472234 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 50/97] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:36:54 2022] GET /identity/v3/role_assignments?user.id=10854b3b3c7d41e986054d0f542ffe6e&scope.project.id=1d43cdebf69c4cedabe6fc514bb04524&role.id=538580824ccd4e02823540ee3df31cdc => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:55.445898 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223433f-96a0-4047-82ce-f75cb495f048 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:55.446411 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223433f-96a0-4047-82ce-f75cb495f048 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:55.446524 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6223433f-96a0-4047-82ce-f75cb495f048 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:55.448048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 48/98] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:36:55.453544 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233731e-dcd3-4367-9e3a-24a14cc23b86 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:55.453954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233731e-dcd3-4367-9e3a-24a14cc23b86 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:55.454143 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233731e-dcd3-4367-9e3a-24a14cc23b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:55.488415 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-7233731e-dcd3-4367-9e3a-24a14cc23b86 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:36:55.489641 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-7233731e-dcd3-4367-9e3a-24a14cc23b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:36:55.528364 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:55.584860 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 51/99] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 02 20:36:55.615297 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00148b3d-2f51-4ba3-a28f-56bebfc73bb7 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:55.615614 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00148b3d-2f51-4ba3-a28f-56bebfc73bb7 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:55.615869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00148b3d-2f51-4ba3-a28f-56bebfc73bb7 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:55.617394 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 49/100] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:36:55.623215 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc6da9-5af2-46b6-89cf-63e8411cec32 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:55.623508 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc6da9-5af2-46b6-89cf-63e8411cec32 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:55.623790 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc6da9-5af2-46b6-89cf-63e8411cec32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:55.636775 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00148b3d-2f51-4ba3-a28f-56bebfc73bb7 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:55.670235 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-47dc6da9-5af2-46b6-89cf-63e8411cec32 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:36:55.674309 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-47dc6da9-5af2-46b6-89cf-63e8411cec32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:36:55.793433 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 52/101] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:36:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:36:55.815898 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00148b3d-2f51-4ba3-a28f-56bebfc73bb7 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:55.829928 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc6da9-5af2-46b6-89cf-63e8411cec32 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:55.881196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c739f6-d4a2-4654-8cf1-35d2b10bbfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:55.882015 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c739f6-d4a2-4654-8cf1-35d2b10bbfc4 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:55.882302 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c739f6-d4a2-4654-8cf1-35d2b10bbfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:55.882581 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c739f6-d4a2-4654-8cf1-35d2b10bbfc4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:55.883902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c739f6-d4a2-4654-8cf1-35d2b10bbfc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:55.885530 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c739f6-d4a2-4654-8cf1-35d2b10bbfc4 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:55.887711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 50/102] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:36:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:36:55.893229 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c739f6-d4a2-4654-8cf1-35d2b10bbfc4 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:55.947424 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:55.960037 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc6da9-5af2-46b6-89cf-63e8411cec32 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:55.961662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:55.996465 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c739f6-d4a2-4654-8cf1-35d2b10bbfc4 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:55.999535 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2fbb5-c2e7-4617-9f1c-80fb076814a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:56.000586 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2fbb5-c2e7-4617-9f1c-80fb076814a9 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:56.001068 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2fbb5-c2e7-4617-9f1c-80fb076814a9 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:56.001603 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2fbb5-c2e7-4617-9f1c-80fb076814a9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:56.013278 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2fbb5-c2e7-4617-9f1c-80fb076814a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:36:56.021974 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-dde2fbb5-c2e7-4617-9f1c-80fb076814a9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:36:56.021974 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:36:56.021974 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:36:56.021974 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:36:56.021974 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:36:56.021974 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:36:56.021974 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:36:56.021974 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:36:56.021974 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:36:56.021974 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:36:56.021974 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:36:56.021974 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:36:56.021974 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:36:56.021974 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:36:56.021974 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:36:56.021974 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:36:56.022849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:36:56.022849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:36:56.022849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:36:56.022849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:36:56.022849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:36:56.022849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:36:56.022849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:36:56.022849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:36:56.022849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:36:56.022849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:36:56.022849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:36:56.022849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:36:56.022849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:36:56.022849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:36:56.022849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:36:56.022849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:36:56.023673 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:36:56.023673 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:36:56.023673 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:36:56.023673 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:36:56.023673 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:36:56.023673 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:36:56.023673 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:36:56.023673 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:36:56.023673 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:36:56.023673 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:36:56.023673 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:36:56.023673 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:36:56.026516 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 53/103] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:36:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:36:56.031904 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2fbb5-c2e7-4617-9f1c-80fb076814a9 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:56.034309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413f7f2-2dea-4a44-9759-6606c530f56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:56.035116 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413f7f2-2dea-4a44-9759-6606c530f56c None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:56.035404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413f7f2-2dea-4a44-9759-6606c530f56c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:56.035693 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413f7f2-2dea-4a44-9759-6606c530f56c None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:56.036398 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413f7f2-2dea-4a44-9759-6606c530f56c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:56.037875 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2413f7f2-2dea-4a44-9759-6606c530f56c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:56.094880 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 51/104] 10.222.0.57 () {60 vars in 1141 bytes} [Sat Jul 2 20:36:55 2022] POST /identity/v3/projects => generated 302 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 20:36:56.242779 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2fbb5-c2e7-4617-9f1c-80fb076814a9 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:56.351363 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82975d-6d5f-4b79-ab8e-7c273ecfaf59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:56.352082 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82975d-6d5f-4b79-ab8e-7c273ecfaf59 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:56.352369 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82975d-6d5f-4b79-ab8e-7c273ecfaf59 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:56.352650 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82975d-6d5f-4b79-ab8e-7c273ecfaf59 None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:56.353427 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82975d-6d5f-4b79-ab8e-7c273ecfaf59 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:36:56.353737 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82975d-6d5f-4b79-ab8e-7c273ecfaf59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:56.355215 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d82975d-6d5f-4b79-ab8e-7c273ecfaf59 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:56.377517 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 54/105] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:36:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:36:56.384155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413f7f2-2dea-4a44-9759-6606c530f56c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:56.546393 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413f7f2-2dea-4a44-9759-6606c530f56c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:56.575182 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:56.600313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa41cba-7184-4abe-9846-19217222ba7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:56.601481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa41cba-7184-4abe-9846-19217222ba7e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:56.601728 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa41cba-7184-4abe-9846-19217222ba7e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:56.602009 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa41cba-7184-4abe-9846-19217222ba7e None admin] PATH_INFO: `/v3/users/d715d482cc234c2191f7d3253f02fff9` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:56.625187 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa41cba-7184-4abe-9846-19217222ba7e None admin] RBAC: Authorizing `identity:get_user(user_id=d715d482cc234c2191f7d3253f02fff9)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:56.626895 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa41cba-7184-4abe-9846-19217222ba7e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:56.629018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 52/106] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:36:56 2022] GET /identity/v3/users/d715d482cc234c2191f7d3253f02fff9 => generated 289 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:56.634579 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82975d-6d5f-4b79-ab8e-7c273ecfaf59 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:56.655418 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:56.775359 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82975d-6d5f-4b79-ab8e-7c273ecfaf59 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:56.817674 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9526591-deed-49d2-b493-1b77d4378d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:56.818418 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9526591-deed-49d2-b493-1b77d4378d2c None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:56.818710 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9526591-deed-49d2-b493-1b77d4378d2c None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:56.819058 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9526591-deed-49d2-b493-1b77d4378d2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:56.908729 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9526591-deed-49d2-b493-1b77d4378d2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:56.910180 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9526591-deed-49d2-b493-1b77d4378d2c None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:56.929557 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:57.029762 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 55/107] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:36:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:36:57.035821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa41cba-7184-4abe-9846-19217222ba7e None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:57.161088 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa41cba-7184-4abe-9846-19217222ba7e None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:57.205384 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5835e-07eb-48dc-be80-852c03a99b21 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:57.205717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5835e-07eb-48dc-be80-852c03a99b21 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:57.205956 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b5835e-07eb-48dc-be80-852c03a99b21 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:57.207573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 56/108] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:36:57.208468 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f1744c-eb53-4051-93bd-4b50c9278bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:57.209351 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1744c-eb53-4051-93bd-4b50c9278bce None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:57.209634 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1744c-eb53-4051-93bd-4b50c9278bce None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:57.209906 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f1744c-eb53-4051-93bd-4b50c9278bce None admin] PATH_INFO: `/v3/projects/17380892ecb2424e932154c8ad8864b7` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:57.211168 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1744c-eb53-4051-93bd-4b50c9278bce None admin] RBAC: Authorizing `identity:get_project(project_id=17380892ecb2424e932154c8ad8864b7)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:57.212640 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f1744c-eb53-4051-93bd-4b50c9278bce None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:57.214511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 53/109] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:36:57 2022] GET /identity/v3/projects/17380892ecb2424e932154c8ad8864b7 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:57.220554 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e371b-0219-4546-af26-9ec07b22c025 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:57.220849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e371b-0219-4546-af26-9ec07b22c025 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:57.221132 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968e371b-0219-4546-af26-9ec07b22c025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:57.228439 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcea1d-1d5d-4b85-ad6f-fac848d6d543 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:57.228728 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcea1d-1d5d-4b85-ad6f-fac848d6d543 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:57.229013 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dcea1d-1d5d-4b85-ad6f-fac848d6d543 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:57.234948 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 54/110] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:36:57 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:36:57.237340 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dcea1d-1d5d-4b85-ad6f-fac848d6d543 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:57.244061 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-968e371b-0219-4546-af26-9ec07b22c025 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:36:57.245264 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-968e371b-0219-4546-af26-9ec07b22c025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:36:57.330494 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:57.376030 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 57/111] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:36:57.377726 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2228dfa-b791-4405-aadd-67af5866b5c0 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:57.378023 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2228dfa-b791-4405-aadd-67af5866b5c0 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:57.378311 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2228dfa-b791-4405-aadd-67af5866b5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:57.407172 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-a2228dfa-b791-4405-aadd-67af5866b5c0 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:36:57.408518 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-a2228dfa-b791-4405-aadd-67af5866b5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:36:57.447412 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:57.451620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dcea1d-1d5d-4b85-ad6f-fac848d6d543 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:57.484990 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 58/112] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:36:57.485973 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2228dfa-b791-4405-aadd-67af5866b5c0 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:57.518231 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521c14f-2d20-4afc-83f5-a2c4a583007f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:57.519332 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521c14f-2d20-4afc-83f5-a2c4a583007f None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:57.519617 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521c14f-2d20-4afc-83f5-a2c4a583007f None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:57.520098 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521c14f-2d20-4afc-83f5-a2c4a583007f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:57.520938 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521c14f-2d20-4afc-83f5-a2c4a583007f None admin] RBAC: Adding query filter params (role.id=5c2e2429808f41468c9b5a93d74645ba, scope.project.id=17380892ecb2424e932154c8ad8864b7, user.id=d715d482cc234c2191f7d3253f02fff9) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:36:57.521247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521c14f-2d20-4afc-83f5-a2c4a583007f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:57.524165 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521c14f-2d20-4afc-83f5-a2c4a583007f None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:57.538220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 55/113] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:36:57 2022] GET /identity/v3/role_assignments?user.id=d715d482cc234c2191f7d3253f02fff9&scope.project.id=17380892ecb2424e932154c8ad8864b7&role.id=5c2e2429808f41468c9b5a93d74645ba => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:57.540026 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521c14f-2d20-4afc-83f5-a2c4a583007f None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:57.685662 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2228dfa-b791-4405-aadd-67af5866b5c0 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:57.768551 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25978c5-b8e3-4967-96c3-c8d27ba84c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:57.769390 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25978c5-b8e3-4967-96c3-c8d27ba84c23 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:57.769674 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25978c5-b8e3-4967-96c3-c8d27ba84c23 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:57.769949 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25978c5-b8e3-4967-96c3-c8d27ba84c23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:57.795650 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25978c5-b8e3-4967-96c3-c8d27ba84c23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:36:57.804295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-b25978c5-b8e3-4967-96c3-c8d27ba84c23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:36:57.804295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:36:57.804295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:36:57.804295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:36:57.804295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:36:57.804295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:36:57.804295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:36:57.804295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:36:57.804295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:36:57.804295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:36:57.804295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:36:57.804295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:36:57.804295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:36:57.804295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:36:57.804295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:36:57.804295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:36:57.805226 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:36:57.805226 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:36:57.805226 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:36:57.805226 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:36:57.805226 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:36:57.805226 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:36:57.805226 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:36:57.805226 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:36:57.805226 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:36:57.805226 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:36:57.805226 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:36:57.805226 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:36:57.805226 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:36:57.805226 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:36:57.805226 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:36:57.805226 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:36:57.805978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:36:57.805978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:36:57.805978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:36:57.805978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:36:57.805978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:36:57.805978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:36:57.805978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:36:57.805978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:36:57.805978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:36:57.805978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:36:57.805978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:36:57.805978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:36:57.807383 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521c14f-2d20-4afc-83f5-a2c4a583007f None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:57.808450 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 59/114] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jul 2 20:36:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:36:57.823764 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25978c5-b8e3-4967-96c3-c8d27ba84c23 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:57.827277 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:57.874930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bae5d-20c5-4aaf-8504-ec3100fa674b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:57.874930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bae5d-20c5-4aaf-8504-ec3100fa674b None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:57.874930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bae5d-20c5-4aaf-8504-ec3100fa674b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:57.874930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bae5d-20c5-4aaf-8504-ec3100fa674b None admin] PATH_INFO: `/v3/roles/member` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:57.899993 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434bae5d-20c5-4aaf-8504-ec3100fa674b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:36:57.908987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-434bae5d-20c5-4aaf-8504-ec3100fa674b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:36:57.908987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:36:57.908987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:36:57.908987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:36:57.908987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:36:57.908987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:36:57.908987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:36:57.908987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:36:57.908987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:36:57.908987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:36:57.908987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:36:57.908987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:36:57.908987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:36:57.908987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:36:57.908987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:36:57.908987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:36:57.909893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:36:57.909893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:36:57.909893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:36:57.909893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:36:57.909893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:36:57.909893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:36:57.909893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:36:57.909893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:36:57.909893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:36:57.909893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:36:57.909893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:36:57.909893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:36:57.909893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:36:57.909893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:36:57.909893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:36:57.909893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:36:57.910677 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:36:57.910677 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:36:57.910677 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:36:57.910677 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:36:57.910677 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:36:57.910677 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:36:57.910677 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:36:57.910677 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:36:57.910677 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:36:57.910677 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:36:57.910677 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:36:57.910677 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:36:57.911290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 56/115] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:36:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:36:57.911358 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:57.916944 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bae5d-20c5-4aaf-8504-ec3100fa674b None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:58.029956 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bae5d-20c5-4aaf-8504-ec3100fa674b None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:58.049883 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25978c5-b8e3-4967-96c3-c8d27ba84c23 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:58.068762 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a975e4-f8bd-469b-aca0-059ca7bd848f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:58.069593 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a975e4-f8bd-469b-aca0-059ca7bd848f None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:58.069889 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a975e4-f8bd-469b-aca0-059ca7bd848f None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:58.070183 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a975e4-f8bd-469b-aca0-059ca7bd848f None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:58.070977 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a975e4-f8bd-469b-aca0-059ca7bd848f None admin] RBAC: Adding query filter params (name=member) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:36:58.071297 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a975e4-f8bd-469b-aca0-059ca7bd848f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:58.072974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a975e4-f8bd-469b-aca0-059ca7bd848f None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:58.083406 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 57/116] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:36:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:36:58.084958 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fd90f-21e8-4fe7-a577-ea8a7e387296 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:58.085258 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fd90f-21e8-4fe7-a577-ea8a7e387296 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:58.085543 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1fd90f-21e8-4fe7-a577-ea8a7e387296 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:58.086974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 58/117] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:36:58.092306 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fd90f-21e8-4fe7-a577-ea8a7e387296 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:58.127858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:58.129366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b64642-31c8-4975-8673-34f781d691c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:58.130290 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b64642-31c8-4975-8673-34f781d691c5 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:58.130754 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b64642-31c8-4975-8673-34f781d691c5 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:58.131214 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b64642-31c8-4975-8673-34f781d691c5 None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:58.132136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b64642-31c8-4975-8673-34f781d691c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:36:58.132629 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b64642-31c8-4975-8673-34f781d691c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:58.134282 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b64642-31c8-4975-8673-34f781d691c5 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:58.154178 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 60/118] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:36:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:36:58.155823 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76400df3-01a5-4131-8b0b-d007aa04e11e None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:58.156279 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76400df3-01a5-4131-8b0b-d007aa04e11e None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:58.156718 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76400df3-01a5-4131-8b0b-d007aa04e11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:58.195969 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-76400df3-01a5-4131-8b0b-d007aa04e11e None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:36:58.197199 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-76400df3-01a5-4131-8b0b-d007aa04e11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:36:58.209516 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1fd90f-21e8-4fe7-a577-ea8a7e387296 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:58.270806 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c19c2-9ed6-4d03-ba68-10f9ba6d875c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:58.272983 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c19c2-9ed6-4d03-ba68-10f9ba6d875c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:58.273272 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c19c2-9ed6-4d03-ba68-10f9ba6d875c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:58.273552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c19c2-9ed6-4d03-ba68-10f9ba6d875c None admin] PATH_INFO: `/v3/users/10854b3b3c7d41e986054d0f542ffe6e` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:58.278178 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c19c2-9ed6-4d03-ba68-10f9ba6d875c None admin] RBAC: Authorizing `identity:get_user(user_id=10854b3b3c7d41e986054d0f542ffe6e)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:58.279772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c19c2-9ed6-4d03-ba68-10f9ba6d875c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:58.281599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 59/119] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:36:58 2022] GET /identity/v3/users/10854b3b3c7d41e986054d0f542ffe6e => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:58.282353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c19c2-9ed6-4d03-ba68-10f9ba6d875c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:58.372237 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 61/120] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:36:58.373302 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76400df3-01a5-4131-8b0b-d007aa04e11e None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:58.414988 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:58.427921 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:58.432374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c19c2-9ed6-4d03-ba68-10f9ba6d875c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:58.475693 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9904610-e92a-4b6e-8bbd-6f15df8d997e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:58.476910 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904610-e92a-4b6e-8bbd-6f15df8d997e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:58.478116 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904610-e92a-4b6e-8bbd-6f15df8d997e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:58.478475 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9904610-e92a-4b6e-8bbd-6f15df8d997e None admin] PATH_INFO: `/v3/users/a74d0c542d434c4296a1d1b26dca9bac` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:58.479813 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9904610-e92a-4b6e-8bbd-6f15df8d997e None admin] RBAC: Authorizing `identity:get_user(user_id=a74d0c542d434c4296a1d1b26dca9bac)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:58.481496 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9904610-e92a-4b6e-8bbd-6f15df8d997e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:58.483938 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 60/121] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:36:58 2022] GET /identity/v3/users/a74d0c542d434c4296a1d1b26dca9bac => generated 247 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:58.485097 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e35da0-a41b-4c3b-93bf-5a5d9900b9ab None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:58.485450 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e35da0-a41b-4c3b-93bf-5a5d9900b9ab None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:58.485864 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e35da0-a41b-4c3b-93bf-5a5d9900b9ab None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:58.487187 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 61/122] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:36:58.487955 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e35da0-a41b-4c3b-93bf-5a5d9900b9ab None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:58.529602 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76400df3-01a5-4131-8b0b-d007aa04e11e None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:58.576789 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774d08e-efe3-4b48-9501-55def8dceefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:58.578080 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774d08e-efe3-4b48-9501-55def8dceefe None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:58.578367 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774d08e-efe3-4b48-9501-55def8dceefe None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:58.578652 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774d08e-efe3-4b48-9501-55def8dceefe None admin] PATH_INFO: `/v3/projects/17380892ecb2424e932154c8ad8864b7` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:58.580502 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774d08e-efe3-4b48-9501-55def8dceefe None admin] RBAC: Authorizing `identity:get_project(project_id=17380892ecb2424e932154c8ad8864b7)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:58.582113 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774d08e-efe3-4b48-9501-55def8dceefe None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:58.585141 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 62/123] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:36:58 2022] GET /identity/v3/projects/17380892ecb2424e932154c8ad8864b7 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:58.586081 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774d08e-efe3-4b48-9501-55def8dceefe None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:58.614231 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e35da0-a41b-4c3b-93bf-5a5d9900b9ab None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:58.663345 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b6a56f-14fe-40d5-898d-4d1994e0c620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:58.664665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6a56f-14fe-40d5-898d-4d1994e0c620 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:58.665119 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6a56f-14fe-40d5-898d-4d1994e0c620 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:58.665744 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b6a56f-14fe-40d5-898d-4d1994e0c620 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:58.679678 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b6a56f-14fe-40d5-898d-4d1994e0c620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:36:58.691448 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-c7b6a56f-14fe-40d5-898d-4d1994e0c620 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:36:58.691448 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:36:58.691448 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:36:58.691448 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:36:58.691448 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:36:58.691448 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:36:58.691448 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:36:58.691448 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:36:58.691448 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:36:58.691448 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:36:58.691448 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:36:58.691448 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:36:58.691448 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:36:58.691448 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:36:58.691448 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:36:58.691448 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:36:58.692470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:36:58.692470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:36:58.692470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:36:58.692470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:36:58.692470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:36:58.692470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:36:58.692470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:36:58.692470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:36:58.692470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:36:58.692470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:36:58.692470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:36:58.692470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:36:58.692470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:36:58.692470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:36:58.692470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:36:58.692470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:36:58.693432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:36:58.693432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:36:58.693432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:36:58.693432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:36:58.693432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:36:58.693432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:36:58.693432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:36:58.693432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:36:58.693432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:36:58.693432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:36:58.693432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:36:58.693432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:36:58.700405 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 62/124] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jul 2 20:36:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:36:58.701979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12147268-503f-4567-a3e6-917538c14ad4 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:58.703392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12147268-503f-4567-a3e6-917538c14ad4 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:58.703815 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12147268-503f-4567-a3e6-917538c14ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:58.707211 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:58.722146 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774d08e-efe3-4b48-9501-55def8dceefe None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:58.727890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-12147268-503f-4567-a3e6-917538c14ad4 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:36:58.729073 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-12147268-503f-4567-a3e6-917538c14ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:36:58.758593 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:58.765586 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb4760-f215-483e-80c8-dd006fe83805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:58.766739 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb4760-f215-483e-80c8-dd006fe83805 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:58.767462 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb4760-f215-483e-80c8-dd006fe83805 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:58.767755 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efb4760-f215-483e-80c8-dd006fe83805 None admin] PATH_INFO: `/v3/projects/17380892ecb2424e932154c8ad8864b7` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:58.769185 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb4760-f215-483e-80c8-dd006fe83805 None admin] RBAC: Authorizing `identity:get_project(project_id=17380892ecb2424e932154c8ad8864b7)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:58.770718 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4efb4760-f215-483e-80c8-dd006fe83805 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:58.772568 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 63/125] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:36:58 2022] GET /identity/v3/projects/17380892ecb2424e932154c8ad8864b7 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:58.774449 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb4760-f215-483e-80c8-dd006fe83805 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:58.807290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 63/126] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:36:58.808522 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12147268-503f-4567-a3e6-917538c14ad4 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:58.900256 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efb4760-f215-483e-80c8-dd006fe83805 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:58.944883 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e989c1-9d9f-43ea-b5bd-499019184313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:58.946199 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e989c1-9d9f-43ea-b5bd-499019184313 None admin] REQUEST_METHOD: `PUT` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:58.946487 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e989c1-9d9f-43ea-b5bd-499019184313 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:58.946764 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e989c1-9d9f-43ea-b5bd-499019184313 None admin] PATH_INFO: `/v3/projects/17380892ecb2424e932154c8ad8864b7/users/10854b3b3c7d41e986054d0f542ffe6e/roles/538580824ccd4e02823540ee3df31cdc` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:58.949110 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e989c1-9d9f-43ea-b5bd-499019184313 None admin] RBAC: Authorizing `identity:create_grant(project_id=17380892ecb2424e932154c8ad8864b7, user_id=10854b3b3c7d41e986054d0f542ffe6e, role_id=538580824ccd4e02823540ee3df31cdc)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:58.949452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12147268-503f-4567-a3e6-917538c14ad4 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:58.950582 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e989c1-9d9f-43ea-b5bd-499019184313 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:58.975579 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 64/127] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jul 2 20:36:58 2022] PUT /identity/v3/projects/17380892ecb2424e932154c8ad8864b7/users/10854b3b3c7d41e986054d0f542ffe6e/roles/538580824ccd4e02823540ee3df31cdc => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:36:58.977019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e989c1-9d9f-43ea-b5bd-499019184313 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:58.990211 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2b7b3-657b-4eb4-b4bd-36311b1ee67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:58.991493 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2b7b3-657b-4eb4-b4bd-36311b1ee67c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:58.991998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2b7b3-657b-4eb4-b4bd-36311b1ee67c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:58.992506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2b7b3-657b-4eb4-b4bd-36311b1ee67c None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:58.993645 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2b7b3-657b-4eb4-b4bd-36311b1ee67c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:36:58.994209 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2b7b3-657b-4eb4-b4bd-36311b1ee67c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:58.996065 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2b7b3-657b-4eb4-b4bd-36311b1ee67c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:59.006492 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 64/128] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:36:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:59.006705 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:59.007892 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2b7b3-657b-4eb4-b4bd-36311b1ee67c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:59.035917 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:59.135709 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e989c1-9d9f-43ea-b5bd-499019184313 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:59.136211 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2b7b3-657b-4eb4-b4bd-36311b1ee67c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:59.178604 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26348db6-dd61-4bc7-80de-9204eb0137de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:59.179466 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26348db6-dd61-4bc7-80de-9204eb0137de None admin] REQUEST_METHOD: `PUT` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:59.179748 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26348db6-dd61-4bc7-80de-9204eb0137de None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:59.180022 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26348db6-dd61-4bc7-80de-9204eb0137de None admin] PATH_INFO: `/v3/projects/17380892ecb2424e932154c8ad8864b7/users/a74d0c542d434c4296a1d1b26dca9bac/roles/353a58700c5640988ce2c9012e847cf8` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:59.182731 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26348db6-dd61-4bc7-80de-9204eb0137de None admin] RBAC: Authorizing `identity:create_grant(project_id=17380892ecb2424e932154c8ad8864b7, user_id=a74d0c542d434c4296a1d1b26dca9bac, role_id=353a58700c5640988ce2c9012e847cf8)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:59.184855 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26348db6-dd61-4bc7-80de-9204eb0137de None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:59.197795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f66bf-d26a-4d5e-9ff1-eeb6e4475d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:59.198676 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f66bf-d26a-4d5e-9ff1-eeb6e4475d22 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:59.199021 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f66bf-d26a-4d5e-9ff1-eeb6e4475d22 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:59.199486 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f66bf-d26a-4d5e-9ff1-eeb6e4475d22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:59.212113 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 65/129] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jul 2 20:36:58 2022] PUT /identity/v3/projects/17380892ecb2424e932154c8ad8864b7/users/a74d0c542d434c4296a1d1b26dca9bac/roles/353a58700c5640988ce2c9012e847cf8 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:36:59.213071 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26348db6-dd61-4bc7-80de-9204eb0137de None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:59.231465 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5f66bf-d26a-4d5e-9ff1-eeb6e4475d22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:36:59.246811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-4f5f66bf-d26a-4d5e-9ff1-eeb6e4475d22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:36:59.246811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:36:59.246811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:36:59.246811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:36:59.246811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:36:59.246811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:36:59.246811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:36:59.246811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:36:59.246811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:36:59.246811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:36:59.246811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:36:59.246811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:36:59.246811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:36:59.246811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:36:59.246811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:36:59.246811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:36:59.247822 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:36:59.247822 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:36:59.247822 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:36:59.247822 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:36:59.247822 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:36:59.247822 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:36:59.247822 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:36:59.247822 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:36:59.247822 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:36:59.247822 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:36:59.247822 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:36:59.247822 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:36:59.247822 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:36:59.247822 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:36:59.247822 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:36:59.247822 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:36:59.248634 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:36:59.248634 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:36:59.248634 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:36:59.248634 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:36:59.248634 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:36:59.248634 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:36:59.248634 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:36:59.248634 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:36:59.248634 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:36:59.248634 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:36:59.248634 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:36:59.248634 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:36:59.249221 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 65/130] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:36:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:36:59.257693 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f66bf-d26a-4d5e-9ff1-eeb6e4475d22 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:59.344854 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:59.369602 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26348db6-dd61-4bc7-80de-9204eb0137de None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:59.370159 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:59.391171 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5f66bf-d26a-4d5e-9ff1-eeb6e4475d22 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:59.414578 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e17f9-8c8d-4e57-aca7-918e03d3353f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:59.415519 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e17f9-8c8d-4e57-aca7-918e03d3353f None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:59.415802 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e17f9-8c8d-4e57-aca7-918e03d3353f None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:59.416075 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e17f9-8c8d-4e57-aca7-918e03d3353f None admin] PATH_INFO: `/v3/users/10854b3b3c7d41e986054d0f542ffe6e` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:59.417334 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e17f9-8c8d-4e57-aca7-918e03d3353f None admin] RBAC: Authorizing `identity:get_user(user_id=10854b3b3c7d41e986054d0f542ffe6e)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:59.418840 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e17f9-8c8d-4e57-aca7-918e03d3353f None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:59.420760 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 66/131] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:36:59 2022] GET /identity/v3/users/10854b3b3c7d41e986054d0f542ffe6e => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:59.431050 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e17f9-8c8d-4e57-aca7-918e03d3353f None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:59.433633 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaaad04-feba-4be0-9661-dbf810804924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:59.434336 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaaad04-feba-4be0-9661-dbf810804924 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:59.434620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaaad04-feba-4be0-9661-dbf810804924 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:59.434897 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaaad04-feba-4be0-9661-dbf810804924 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:59.435696 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaaad04-feba-4be0-9661-dbf810804924 None admin] RBAC: Adding query filter params (name=member) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:36:59.436000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaaad04-feba-4be0-9661-dbf810804924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:59.437476 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaaad04-feba-4be0-9661-dbf810804924 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:59.446848 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 66/132] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:36:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:59.452972 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaaad04-feba-4be0-9661-dbf810804924 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:59.559676 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaaad04-feba-4be0-9661-dbf810804924 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:59.572826 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e17f9-8c8d-4e57-aca7-918e03d3353f None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:59.612142 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93191962-85fb-44c9-8487-cfe5ad4b57cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:59.613043 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93191962-85fb-44c9-8487-cfe5ad4b57cf None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:59.613324 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93191962-85fb-44c9-8487-cfe5ad4b57cf None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:59.613598 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93191962-85fb-44c9-8487-cfe5ad4b57cf None admin] PATH_INFO: `/v3/projects/17380892ecb2424e932154c8ad8864b7` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:59.614870 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93191962-85fb-44c9-8487-cfe5ad4b57cf None admin] RBAC: Authorizing `identity:get_project(project_id=17380892ecb2424e932154c8ad8864b7)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:59.616407 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93191962-85fb-44c9-8487-cfe5ad4b57cf None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:59.617578 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8d27b-bd22-4f57-bde0-4c99136cf78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:59.618166 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 67/133] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:36:59 2022] GET /identity/v3/projects/17380892ecb2424e932154c8ad8864b7 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:36:59.618490 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8d27b-bd22-4f57-bde0-4c99136cf78c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:59.618769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8d27b-bd22-4f57-bde0-4c99136cf78c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:59.619066 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8d27b-bd22-4f57-bde0-4c99136cf78c None admin] PATH_INFO: `/v3/users/10854b3b3c7d41e986054d0f542ffe6e` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:59.624905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8d27b-bd22-4f57-bde0-4c99136cf78c None admin] RBAC: Authorizing `identity:get_user(user_id=10854b3b3c7d41e986054d0f542ffe6e)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:59.625061 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93191962-85fb-44c9-8487-cfe5ad4b57cf None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:59.625322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da8d27b-bd22-4f57-bde0-4c99136cf78c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:59.627576 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 67/134] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:36:59 2022] GET /identity/v3/users/10854b3b3c7d41e986054d0f542ffe6e => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:36:59.632842 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8d27b-bd22-4f57-bde0-4c99136cf78c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:59.644690 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:59.647271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:36:59.737392 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93191962-85fb-44c9-8487-cfe5ad4b57cf None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:59.756468 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da8d27b-bd22-4f57-bde0-4c99136cf78c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:36:59.774323 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc4f7a-9a58-43f9-8485-594a779f56f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:59.775452 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc4f7a-9a58-43f9-8485-594a779f56f1 None admin] REQUEST_METHOD: `PUT` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:59.775738 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc4f7a-9a58-43f9-8485-594a779f56f1 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:59.776015 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc4f7a-9a58-43f9-8485-594a779f56f1 None admin] PATH_INFO: `/v3/projects/17380892ecb2424e932154c8ad8864b7/users/10854b3b3c7d41e986054d0f542ffe6e/roles/a03f493abb6846eebc4958aabe8b28ad` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:59.778409 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc4f7a-9a58-43f9-8485-594a779f56f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=17380892ecb2424e932154c8ad8864b7, user_id=10854b3b3c7d41e986054d0f542ffe6e, role_id=a03f493abb6846eebc4958aabe8b28ad)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:59.779972 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc4f7a-9a58-43f9-8485-594a779f56f1 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:59.797224 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 68/135] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jul 2 20:36:59 2022] PUT /identity/v3/projects/17380892ecb2424e932154c8ad8864b7/users/10854b3b3c7d41e986054d0f542ffe6e/roles/a03f493abb6846eebc4958aabe8b28ad => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 20:36:59.799490 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26d1c6-6f39-4c82-bc8d-7ba67efdb922 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:59.800028 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26d1c6-6f39-4c82-bc8d-7ba67efdb922 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:59.800499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d26d1c6-6f39-4c82-bc8d-7ba67efdb922 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:59.809117 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 69/136] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:36:59 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:36:59.815488 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5430fd-952d-4592-8d86-e4a1ffa668ca None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:59.815773 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5430fd-952d-4592-8d86-e4a1ffa668ca None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:59.816068 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5430fd-952d-4592-8d86-e4a1ffa668ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:59.824018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b34dbb-9377-4350-a8ec-26ea01b55f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:36:59.825332 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b34dbb-9377-4350-a8ec-26ea01b55f20 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:36:59.825809 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b34dbb-9377-4350-a8ec-26ea01b55f20 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:36:59.826348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b34dbb-9377-4350-a8ec-26ea01b55f20 None admin] PATH_INFO: `/v3/projects/1d43cdebf69c4cedabe6fc514bb04524` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:36:59.831680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b34dbb-9377-4350-a8ec-26ea01b55f20 None admin] RBAC: Authorizing `identity:get_project(project_id=1d43cdebf69c4cedabe6fc514bb04524)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:36:59.833277 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b34dbb-9377-4350-a8ec-26ea01b55f20 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:36:59.835469 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 68/137] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:36:59 2022] GET /identity/v3/projects/1d43cdebf69c4cedabe6fc514bb04524 => generated 312 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:36:59.843395 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b34dbb-9377-4350-a8ec-26ea01b55f20 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:36:59.845478 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-ca5430fd-952d-4592-8d86-e4a1ffa668ca None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:36:59.846841 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-ca5430fd-952d-4592-8d86-e4a1ffa668ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:36:59.945869 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 70/138] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:36:59.978783 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5430fd-952d-4592-8d86-e4a1ffa668ca None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:00.003322 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:00.063563 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:00.081749 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b34dbb-9377-4350-a8ec-26ea01b55f20 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:00.122492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5430fd-952d-4592-8d86-e4a1ffa668ca None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:00.152746 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d10a84-ebd2-43a0-a923-c0bc5f75844e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:00.153704 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d10a84-ebd2-43a0-a923-c0bc5f75844e None admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:00.153982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d10a84-ebd2-43a0-a923-c0bc5f75844e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:00.154260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d10a84-ebd2-43a0-a923-c0bc5f75844e None admin] PATH_INFO: `/v3/projects/1d43cdebf69c4cedabe6fc514bb04524/users/10854b3b3c7d41e986054d0f542ffe6e/roles/538580824ccd4e02823540ee3df31cdc` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:00.160575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d10a84-ebd2-43a0-a923-c0bc5f75844e None admin] RBAC: Authorizing `identity:create_grant(project_id=1d43cdebf69c4cedabe6fc514bb04524, user_id=10854b3b3c7d41e986054d0f542ffe6e, role_id=538580824ccd4e02823540ee3df31cdc)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:00.162086 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d10a84-ebd2-43a0-a923-c0bc5f75844e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:00.169729 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08429389-33d0-4dd1-89c8-e45babf78c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:00.170671 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08429389-33d0-4dd1-89c8-e45babf78c2d None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:00.170974 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08429389-33d0-4dd1-89c8-e45babf78c2d None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:00.171313 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08429389-33d0-4dd1-89c8-e45babf78c2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:00.172948 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08429389-33d0-4dd1-89c8-e45babf78c2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:00.178075 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08429389-33d0-4dd1-89c8-e45babf78c2d None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:00.180229 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 71/139] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:36:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:00.184098 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 69/140] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jul 2 20:36:59 2022] PUT /identity/v3/projects/1d43cdebf69c4cedabe6fc514bb04524/users/10854b3b3c7d41e986054d0f542ffe6e/roles/538580824ccd4e02823540ee3df31cdc => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 20:37:00.189737 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08429389-33d0-4dd1-89c8-e45babf78c2d None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:00.289358 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:00.325576 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08429389-33d0-4dd1-89c8-e45babf78c2d None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:00.379295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f3f88-82c3-46bf-ba46-61b4af331a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:00.380007 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f3f88-82c3-46bf-ba46-61b4af331a3b None admin] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:00.380294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f3f88-82c3-46bf-ba46-61b4af331a3b None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:00.380585 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f3f88-82c3-46bf-ba46-61b4af331a3b None admin] PATH_INFO: `/v3/users` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:00.381383 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f3f88-82c3-46bf-ba46-61b4af331a3b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:00.382986 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f3f88-82c3-46bf-ba46-61b4af331a3b None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:00.411835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 72/141] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jul 2 20:37:00 2022] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:37:00.592437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbde06-01cc-43fa-a473-4f933b1b9c9b None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:00.592837 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbde06-01cc-43fa-a473-4f933b1b9c9b None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:00.593048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccbde06-01cc-43fa-a473-4f933b1b9c9b None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:00.594670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 70/142] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:00.600971 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d57fd9-c86b-4d46-aea6-67d5cc2eca0a None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:00.601295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d57fd9-c86b-4d46-aea6-67d5cc2eca0a None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:00.601527 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d57fd9-c86b-4d46-aea6-67d5cc2eca0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:00.631399 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-67d57fd9-c86b-4d46-aea6-67d5cc2eca0a None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:00.632706 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-67d57fd9-c86b-4d46-aea6-67d5cc2eca0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:00.712871 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 73/143] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:37:00.752648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbde06-01cc-43fa-a473-4f933b1b9c9b None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:00.879360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccbde06-01cc-43fa-a473-4f933b1b9c9b None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:00.916251 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3d402-a1e3-48e2-a3c6-3f9baef3e58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:00.917440 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3d402-a1e3-48e2-a3c6-3f9baef3e58d None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:00.917915 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3d402-a1e3-48e2-a3c6-3f9baef3e58d None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:00.918392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3d402-a1e3-48e2-a3c6-3f9baef3e58d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:00.926801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:00.930662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba3d402-a1e3-48e2-a3c6-3f9baef3e58d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:00.938552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-6ba3d402-a1e3-48e2-a3c6-3f9baef3e58d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:37:00.938552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:00.938552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:00.938552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:00.938552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:00.938552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:00.938552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:00.938552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:00.938552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:00.938552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:00.938552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:00.938552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:00.938552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:00.938552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:00.938552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:00.938552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:00.939487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:00.939487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:00.939487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:00.939487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:00.939487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:00.939487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:00.939487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:00.939487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:00.939487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:00.939487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:00.939487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:00.939487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:00.939487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:00.939487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:00.939487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:00.939487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:00.940265 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:00.940265 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:00.940265 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:00.940265 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:00.940265 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:00.940265 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:00.940265 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:00.940265 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:00.940265 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:00.940265 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:00.940265 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:37:00.940265 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:00.942735 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 71/144] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:00.948904 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d57fd9-c86b-4d46-aea6-67d5cc2eca0a None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:01.047005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:01.100619 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d57fd9-c86b-4d46-aea6-67d5cc2eca0a None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:01.153258 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984af956-0fab-41b0-9eef-671f2dac8090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:01.153855 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984af956-0fab-41b0-9eef-671f2dac8090 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:01.154133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984af956-0fab-41b0-9eef-671f2dac8090 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:01.154457 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984af956-0fab-41b0-9eef-671f2dac8090 None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:01.155342 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984af956-0fab-41b0-9eef-671f2dac8090 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:01.155656 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984af956-0fab-41b0-9eef-671f2dac8090 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:01.157051 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984af956-0fab-41b0-9eef-671f2dac8090 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:01.170563 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 74/145] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:37:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:01.176083 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3d402-a1e3-48e2-a3c6-3f9baef3e58d None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:01.303187 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba3d402-a1e3-48e2-a3c6-3f9baef3e58d None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:01.340331 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f8e61-ed4c-4166-9e7c-f4d8c52eb5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:01.341222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f8e61-ed4c-4166-9e7c-f4d8c52eb5ab None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:01.341511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f8e61-ed4c-4166-9e7c-f4d8c52eb5ab None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:01.341786 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f8e61-ed4c-4166-9e7c-f4d8c52eb5ab None admin] PATH_INFO: `/v3/users/d715d482cc234c2191f7d3253f02fff9` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:01.343018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f8e61-ed4c-4166-9e7c-f4d8c52eb5ab None admin] RBAC: Authorizing `identity:get_user(user_id=d715d482cc234c2191f7d3253f02fff9)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:01.344472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f8e61-ed4c-4166-9e7c-f4d8c52eb5ab None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:01.346370 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 72/146] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:37:01 2022] GET /identity/v3/users/d715d482cc234c2191f7d3253f02fff9 => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:01.356118 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984af956-0fab-41b0-9eef-671f2dac8090 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:01.492992 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984af956-0fab-41b0-9eef-671f2dac8090 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:01.516161 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:01.529856 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc516ec2-c485-4f12-9cfc-e4d288b3fae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:01.530734 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc516ec2-c485-4f12-9cfc-e4d288b3fae6 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:01.531039 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc516ec2-c485-4f12-9cfc-e4d288b3fae6 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:01.531311 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc516ec2-c485-4f12-9cfc-e4d288b3fae6 None admin] PATH_INFO: `/v3/projects/17380892ecb2424e932154c8ad8864b7` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:01.532558 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc516ec2-c485-4f12-9cfc-e4d288b3fae6 None admin] RBAC: Authorizing `identity:get_project(project_id=17380892ecb2424e932154c8ad8864b7)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:01.534024 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc516ec2-c485-4f12-9cfc-e4d288b3fae6 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:01.535768 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 75/147] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:01 2022] GET /identity/v3/projects/17380892ecb2424e932154c8ad8864b7 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:01.541511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f8e61-ed4c-4166-9e7c-f4d8c52eb5ab None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:01.634658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:01.676512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f8e61-ed4c-4166-9e7c-f4d8c52eb5ab None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:01.727044 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc60e00-dacb-42c8-9aa1-a8f2d45a6483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:01.728149 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc60e00-dacb-42c8-9aa1-a8f2d45a6483 None admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:01.728429 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc60e00-dacb-42c8-9aa1-a8f2d45a6483 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:01.728699 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc60e00-dacb-42c8-9aa1-a8f2d45a6483 None admin] PATH_INFO: `/v3/projects/17380892ecb2424e932154c8ad8864b7/users/d715d482cc234c2191f7d3253f02fff9/roles/5c2e2429808f41468c9b5a93d74645ba` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:01.730735 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc60e00-dacb-42c8-9aa1-a8f2d45a6483 None admin] RBAC: Authorizing `identity:create_grant(project_id=17380892ecb2424e932154c8ad8864b7, user_id=d715d482cc234c2191f7d3253f02fff9, role_id=5c2e2429808f41468c9b5a93d74645ba)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:01.732233 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc60e00-dacb-42c8-9aa1-a8f2d45a6483 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:01.747136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 73/148] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jul 2 20:37:01 2022] PUT /identity/v3/projects/17380892ecb2424e932154c8ad8864b7/users/d715d482cc234c2191f7d3253f02fff9/roles/5c2e2429808f41468c9b5a93d74645ba => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:37:02.890418 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9ea57-7f21-480d-951e-301b1620b133 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:02.891049 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9ea57-7f21-480d-951e-301b1620b133 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:02.891049 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9ea57-7f21-480d-951e-301b1620b133 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:02.892810 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 76/149] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:02.898969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79d9a5-9b9e-4b87-abb8-bb3ba4318913 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:02.899429 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79d9a5-9b9e-4b87-abb8-bb3ba4318913 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:02.899529 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de79d9a5-9b9e-4b87-abb8-bb3ba4318913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:02.920562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-de79d9a5-9b9e-4b87-abb8-bb3ba4318913 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:02.921844 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-de79d9a5-9b9e-4b87-abb8-bb3ba4318913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:03.007823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 74/150] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:03.061813 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9ea57-7f21-480d-951e-301b1620b133 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:03.204726 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9ea57-7f21-480d-951e-301b1620b133 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:03.253762 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f96a80-36a7-4131-806e-0b23b586e36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:03.254965 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f96a80-36a7-4131-806e-0b23b586e36f None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:03.255443 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f96a80-36a7-4131-806e-0b23b586e36f None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:03.255906 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f96a80-36a7-4131-806e-0b23b586e36f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:03.271363 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f96a80-36a7-4131-806e-0b23b586e36f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:03.279389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-b5f96a80-36a7-4131-806e-0b23b586e36f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:37:03.279389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:03.279389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:03.279389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:03.279389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:03.279389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:03.279389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:03.279389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:03.279389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:03.279389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:03.279389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:03.279389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:03.279389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:03.279389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:03.279389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:03.279389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:03.280294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:03.280294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:03.280294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:03.280294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:03.280294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:03.280294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:03.280294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:03.280294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:03.280294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:03.280294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:03.280294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:03.280294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:03.280294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:03.280294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:03.280294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:03.280294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:03.281048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:03.281048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:03.281048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:03.281048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:03.281048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:03.281048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:03.281048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:03.281048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:03.281048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:03.281048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:03.281048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:37:03.281048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:03.283768 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 77/151] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jul 2 20:37:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:03.289943 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79d9a5-9b9e-4b87-abb8-bb3ba4318913 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:03.350554 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:03.406540 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de79d9a5-9b9e-4b87-abb8-bb3ba4318913 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:03.446408 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdba70-0cc2-4c7e-b72d-ccdcbe7b1eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:03.447491 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdba70-0cc2-4c7e-b72d-ccdcbe7b1eb6 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:03.447970 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdba70-0cc2-4c7e-b72d-ccdcbe7b1eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:03.448433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdba70-0cc2-4c7e-b72d-ccdcbe7b1eb6 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:03.449410 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdba70-0cc2-4c7e-b72d-ccdcbe7b1eb6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:03.449927 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdba70-0cc2-4c7e-b72d-ccdcbe7b1eb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:03.451558 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bdba70-0cc2-4c7e-b72d-ccdcbe7b1eb6 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:03.466254 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 75/152] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:03.472774 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f96a80-36a7-4131-806e-0b23b586e36f None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:03.536019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:03.601592 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f96a80-36a7-4131-806e-0b23b586e36f None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:03.655683 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4a424a-e62b-4beb-bcaa-5efe5de9c369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:03.656960 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a424a-e62b-4beb-bcaa-5efe5de9c369 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:03.657581 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a424a-e62b-4beb-bcaa-5efe5de9c369 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:03.658102 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4a424a-e62b-4beb-bcaa-5efe5de9c369 None admin] PATH_INFO: `/v3/users/a74d0c542d434c4296a1d1b26dca9bac` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:03.659696 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a424a-e62b-4beb-bcaa-5efe5de9c369 None admin] RBAC: Authorizing `identity:get_user(user_id=a74d0c542d434c4296a1d1b26dca9bac)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:03.661375 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4a424a-e62b-4beb-bcaa-5efe5de9c369 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:03.663332 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 78/153] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:37:03 2022] GET /identity/v3/users/a74d0c542d434c4296a1d1b26dca9bac => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:03.669244 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdba70-0cc2-4c7e-b72d-ccdcbe7b1eb6 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:03.714617 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebda7f7-c9e9-47fb-9e69-54ea31261872 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:03.715283 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebda7f7-c9e9-47fb-9e69-54ea31261872 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:03.715751 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebda7f7-c9e9-47fb-9e69-54ea31261872 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:03.721380 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 79/154] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:03.722796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41defbc-f03f-4365-b5fb-cc3d2b79f791 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:03.723104 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41defbc-f03f-4365-b5fb-cc3d2b79f791 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:03.723378 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41defbc-f03f-4365-b5fb-cc3d2b79f791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:03.758721 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-c41defbc-f03f-4365-b5fb-cc3d2b79f791 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:03.767932 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-c41defbc-f03f-4365-b5fb-cc3d2b79f791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:03.874133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 80/155] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:37:03.922687 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bdba70-0cc2-4c7e-b72d-ccdcbe7b1eb6 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:03.931395 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41defbc-f03f-4365-b5fb-cc3d2b79f791 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:03.958811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:04.023675 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881cbc3d-7d61-4dfb-b7b0-711bd5f85f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:04.024594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cbc3d-7d61-4dfb-b7b0-711bd5f85f5b None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:04.025014 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cbc3d-7d61-4dfb-b7b0-711bd5f85f5b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:04.025449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881cbc3d-7d61-4dfb-b7b0-711bd5f85f5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:04.027269 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:04.078018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41defbc-f03f-4365-b5fb-cc3d2b79f791 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:04.133784 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cbc3d-7d61-4dfb-b7b0-711bd5f85f5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:04.135697 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70becdf3-e29d-40b5-a680-d778aa67ecf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:04.136702 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70becdf3-e29d-40b5-a680-d778aa67ecf3 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:04.137104 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70becdf3-e29d-40b5-a680-d778aa67ecf3 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:04.137493 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70becdf3-e29d-40b5-a680-d778aa67ecf3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:04.139434 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881cbc3d-7d61-4dfb-b7b0-711bd5f85f5b None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:04.156222 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70becdf3-e29d-40b5-a680-d778aa67ecf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:04.172837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-70becdf3-e29d-40b5-a680-d778aa67ecf3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:04.172837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:04.172837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:04.172837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:04.172837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:04.172837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:04.172837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:04.172837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:04.172837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:04.172837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:04.172837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:04.172837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:04.172837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:04.172837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:04.172837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:04.172837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:04.174234 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:04.174234 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:04.174234 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:04.174234 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:04.174234 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:04.174234 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:04.174234 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:04.174234 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:04.174234 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:04.174234 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:04.174234 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:04.174234 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:04.174234 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:04.174234 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:04.174234 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:04.174234 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:04.175066 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:04.175066 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:04.175066 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:04.175066 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:04.175066 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:04.175066 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:04.175066 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:04.175066 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:04.175066 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:04.175066 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:04.175066 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:04.175066 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:04.177478 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 81/156] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:37:04.192228 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70becdf3-e29d-40b5-a680-d778aa67ecf3 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:04.289760 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 76/157] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:37:04.295331 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573aa682-29ae-40ec-b79a-d7acc8289778 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:04.295941 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573aa682-29ae-40ec-b79a-d7acc8289778 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:04.296505 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573aa682-29ae-40ec-b79a-d7acc8289778 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:04.298306 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 77/158] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:37:04.314274 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573aa682-29ae-40ec-b79a-d7acc8289778 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:04.343962 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70becdf3-e29d-40b5-a680-d778aa67ecf3 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:04.353854 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:04.380027 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:04.397680 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3bfc3-0691-405c-b3b3-c8d5ff384901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:04.398149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3bfc3-0691-405c-b3b3-c8d5ff384901 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:04.398427 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3bfc3-0691-405c-b3b3-c8d5ff384901 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:04.398696 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3bfc3-0691-405c-b3b3-c8d5ff384901 None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:04.399481 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3bfc3-0691-405c-b3b3-c8d5ff384901 None admin] RBAC: Adding query filter params (name=member) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:04.399785 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3bfc3-0691-405c-b3b3-c8d5ff384901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:04.401201 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3bfc3-0691-405c-b3b3-c8d5ff384901 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:04.414347 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 82/159] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:37:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:04.415689 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f1291-cee5-4dfb-a662-a27d906d0770 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:04.415949 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f1291-cee5-4dfb-a662-a27d906d0770 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:04.416224 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f1291-cee5-4dfb-a662-a27d906d0770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:04.444997 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-8a4f1291-cee5-4dfb-a662-a27d906d0770 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:04.446180 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-8a4f1291-cee5-4dfb-a662-a27d906d0770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:04.553458 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 83/160] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:04.554121 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f1291-cee5-4dfb-a662-a27d906d0770 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:04.600830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573aa682-29ae-40ec-b79a-d7acc8289778 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:04.683755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8719f-2688-48b3-9052-388a605fc47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:04.684565 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8719f-2688-48b3-9052-388a605fc47a None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:04.684886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8719f-2688-48b3-9052-388a605fc47a None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:04.685155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8719f-2688-48b3-9052-388a605fc47a None admin] PATH_INFO: `/v3/projects/17380892ecb2424e932154c8ad8864b7` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:04.687849 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8719f-2688-48b3-9052-388a605fc47a None admin] RBAC: Authorizing `identity:get_project(project_id=17380892ecb2424e932154c8ad8864b7)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:04.690327 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8719f-2688-48b3-9052-388a605fc47a None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:04.691994 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 78/161] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:04 2022] GET /identity/v3/projects/17380892ecb2424e932154c8ad8864b7 => generated 298 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:04.701634 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8719f-2688-48b3-9052-388a605fc47a None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:04.731282 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:04.735486 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f1291-cee5-4dfb-a662-a27d906d0770 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:04.805371 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7234b862-3c8e-4d5a-a421-a7f92f294027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:04.806271 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234b862-3c8e-4d5a-a421-a7f92f294027 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:04.806550 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234b862-3c8e-4d5a-a421-a7f92f294027 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:04.806819 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7234b862-3c8e-4d5a-a421-a7f92f294027 None admin] PATH_INFO: `/v3/users/10854b3b3c7d41e986054d0f542ffe6e` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:04.809023 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234b862-3c8e-4d5a-a421-a7f92f294027 None admin] RBAC: Authorizing `identity:get_user(user_id=10854b3b3c7d41e986054d0f542ffe6e)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:04.810482 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7234b862-3c8e-4d5a-a421-a7f92f294027 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:04.812398 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 84/162] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:37:04 2022] GET /identity/v3/users/10854b3b3c7d41e986054d0f542ffe6e => generated 275 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:04.813329 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5dc68c-d8a0-43ba-80d3-6410ca842a0d None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:04.813737 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5dc68c-d8a0-43ba-80d3-6410ca842a0d None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:04.814172 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5dc68c-d8a0-43ba-80d3-6410ca842a0d None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:04.815556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 85/163] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:04.817743 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5dc68c-d8a0-43ba-80d3-6410ca842a0d None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:04.881558 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:04.912191 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8719f-2688-48b3-9052-388a605fc47a None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:04.958591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4d48c-27b1-496a-85d2-8b308ef37f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:04.959381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4d48c-27b1-496a-85d2-8b308ef37f5c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:04.959651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4d48c-27b1-496a-85d2-8b308ef37f5c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:04.959923 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d4d48c-27b1-496a-85d2-8b308ef37f5c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:04.982347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d4d48c-27b1-496a-85d2-8b308ef37f5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:04.998361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-f2d4d48c-27b1-496a-85d2-8b308ef37f5c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:37:04.998361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:04.998361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:04.998361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:04.998361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:04.998361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:04.998361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:04.998361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:04.998361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:04.998361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:04.998361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:04.998361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:04.998361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:04.998361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:04.998361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:04.998361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:04.999309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:04.999309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:04.999309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:04.999309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:04.999309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:04.999309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:04.999309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:04.999309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:04.999309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:04.999309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:04.999309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:04.999309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:04.999309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:04.999309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:04.999309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:04.999309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:05.000058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:05.000058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:05.000058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:05.000058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:05.000058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:05.000058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:05.000058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:05.000058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:05.000058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:05.000058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:05.000058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:37:05.000058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:05.002356 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 79/164] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jul 2 20:37:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:05.002474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4d48c-27b1-496a-85d2-8b308ef37f5c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:05.036813 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5dc68c-d8a0-43ba-80d3-6410ca842a0d None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:05.096294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331b2b2-98e1-4178-8e78-c608b7572cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:05.096955 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331b2b2-98e1-4178-8e78-c608b7572cb5 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:05.097231 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331b2b2-98e1-4178-8e78-c608b7572cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:05.097502 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331b2b2-98e1-4178-8e78-c608b7572cb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:05.098337 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331b2b2-98e1-4178-8e78-c608b7572cb5 None admin] RBAC: Adding query filter params (role.id=353a58700c5640988ce2c9012e847cf8, scope.project.id=17380892ecb2424e932154c8ad8864b7, user.id=a74d0c542d434c4296a1d1b26dca9bac) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:05.098646 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331b2b2-98e1-4178-8e78-c608b7572cb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:05.100125 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1331b2b2-98e1-4178-8e78-c608b7572cb5 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:05.106442 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 86/165] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:37:04 2022] GET /identity/v3/role_assignments?user.id=a74d0c542d434c4296a1d1b26dca9bac&scope.project.id=17380892ecb2424e932154c8ad8864b7&role.id=353a58700c5640988ce2c9012e847cf8 => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:05.107511 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb5103-0199-4359-b72d-dc9f00f9e3ae None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:05.107796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb5103-0199-4359-b72d-dc9f00f9e3ae None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:05.108072 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb5103-0199-4359-b72d-dc9f00f9e3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:05.140027 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-fcfb5103-0199-4359-b72d-dc9f00f9e3ae None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:05.141235 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-fcfb5103-0199-4359-b72d-dc9f00f9e3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:05.182680 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:05.232036 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d4d48c-27b1-496a-85d2-8b308ef37f5c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:05.286053 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 87/166] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:05.287312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb5103-0199-4359-b72d-dc9f00f9e3ae None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:05.338939 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5021f-5d99-4f88-96f5-6993a4a40b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:05.339701 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5021f-5d99-4f88-96f5-6993a4a40b81 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:05.339989 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5021f-5d99-4f88-96f5-6993a4a40b81 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:05.340284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5021f-5d99-4f88-96f5-6993a4a40b81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:05.366137 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:05.485021 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5021f-5d99-4f88-96f5-6993a4a40b81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:05.486756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5021f-5d99-4f88-96f5-6993a4a40b81 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:05.509074 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb5103-0199-4359-b72d-dc9f00f9e3ae None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:05.599627 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418a02f9-539d-4a02-8fdb-776c5a0034d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:05.600317 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a02f9-539d-4a02-8fdb-776c5a0034d4 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:05.600589 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a02f9-539d-4a02-8fdb-776c5a0034d4 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:05.600860 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a02f9-539d-4a02-8fdb-776c5a0034d4 None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:05.601614 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a02f9-539d-4a02-8fdb-776c5a0034d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:05.601917 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a02f9-539d-4a02-8fdb-776c5a0034d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:05.603355 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418a02f9-539d-4a02-8fdb-776c5a0034d4 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:05.613068 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 88/167] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:37:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:05.614222 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef844a8-aefe-46cb-902e-83ea72ed3b72 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:05.614512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef844a8-aefe-46cb-902e-83ea72ed3b72 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:05.614788 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef844a8-aefe-46cb-902e-83ea72ed3b72 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:05.616294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 89/168] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:05.616984 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef844a8-aefe-46cb-902e-83ea72ed3b72 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:05.630815 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 80/169] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:37:05.635187 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5021f-5d99-4f88-96f5-6993a4a40b81 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:05.647343 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:05.709430 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:05.752484 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef844a8-aefe-46cb-902e-83ea72ed3b72 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:05.787004 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5021f-5d99-4f88-96f5-6993a4a40b81 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:05.796193 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ee6c69-14b8-4ce2-a158-a936ff3619cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:05.797756 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee6c69-14b8-4ce2-a158-a936ff3619cf None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:05.798288 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee6c69-14b8-4ce2-a158-a936ff3619cf None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:05.798639 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ee6c69-14b8-4ce2-a158-a936ff3619cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:05.814081 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ee6c69-14b8-4ce2-a158-a936ff3619cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:05.825024 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-72ee6c69-14b8-4ce2-a158-a936ff3619cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:05.825024 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:05.825024 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:05.825024 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:05.825024 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:05.825024 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:05.825024 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:05.825024 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:05.825024 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:05.825024 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:05.825024 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:05.825024 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:05.825024 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:05.825024 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:05.825024 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:05.825024 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:05.825976 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:05.825976 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:05.825976 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:05.825976 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:05.825976 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:05.825976 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:05.825976 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:05.825976 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:05.825976 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:05.825976 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:05.825976 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:05.825976 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:05.825976 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:05.825976 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:05.825976 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:05.825976 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:05.826772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:05.826772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:05.826772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:05.826772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:05.826772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:05.826772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:05.826772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:05.826772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:05.826772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:05.826772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:05.826772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:05.826772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:05.826772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 90/170] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:05.828668 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfabed-9a85-4f63-877a-ab94138af55a None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:05.829017 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfabed-9a85-4f63-877a-ab94138af55a None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:05.829448 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfabed-9a85-4f63-877a-ab94138af55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:05.843444 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b4f81-7f46-400b-8070-7a1947235b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:05.845428 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b4f81-7f46-400b-8070-7a1947235b6a None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:05.846094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b4f81-7f46-400b-8070-7a1947235b6a None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:05.846532 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b4f81-7f46-400b-8070-7a1947235b6a None admin] PATH_INFO: `/v3/users/10854b3b3c7d41e986054d0f542ffe6e` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:05.848137 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b4f81-7f46-400b-8070-7a1947235b6a None admin] RBAC: Authorizing `identity:get_user(user_id=10854b3b3c7d41e986054d0f542ffe6e)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:05.849889 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b4f81-7f46-400b-8070-7a1947235b6a None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:05.850662 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-86bfabed-9a85-4f63-877a-ab94138af55a None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:05.852053 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-86bfabed-9a85-4f63-877a-ab94138af55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:05.852471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 81/171] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:37:05 2022] GET /identity/v3/users/10854b3b3c7d41e986054d0f542ffe6e => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:05.853399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b4f81-7f46-400b-8070-7a1947235b6a None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:05.941724 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 91/172] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:05.943512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7e156-753d-40f7-b4a7-f83d45032745 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:05.943876 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7e156-753d-40f7-b4a7-f83d45032745 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:05.944223 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e7e156-753d-40f7-b4a7-f83d45032745 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:05.946219 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 92/173] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:05.946937 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7e156-753d-40f7-b4a7-f83d45032745 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:05.971739 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:05.981690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b4f81-7f46-400b-8070-7a1947235b6a None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:05.997184 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:06.019850 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787726c-47a0-4208-a8d0-b684db0685f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:06.020797 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787726c-47a0-4208-a8d0-b684db0685f5 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:06.021136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787726c-47a0-4208-a8d0-b684db0685f5 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:06.021411 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1787726c-47a0-4208-a8d0-b684db0685f5 None admin] PATH_INFO: `/v3/projects/17380892ecb2424e932154c8ad8864b7` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:06.022829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787726c-47a0-4208-a8d0-b684db0685f5 None admin] RBAC: Authorizing `identity:get_project(project_id=17380892ecb2424e932154c8ad8864b7)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:06.024489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1787726c-47a0-4208-a8d0-b684db0685f5 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:06.026321 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 82/174] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:05 2022] GET /identity/v3/projects/17380892ecb2424e932154c8ad8864b7 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:06.027216 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787726c-47a0-4208-a8d0-b684db0685f5 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:06.068269 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e7e156-753d-40f7-b4a7-f83d45032745 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:06.107532 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74492aa4-3cb9-4f76-8ac1-71d50ce6ce3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:06.108198 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74492aa4-3cb9-4f76-8ac1-71d50ce6ce3e None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:06.108478 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74492aa4-3cb9-4f76-8ac1-71d50ce6ce3e None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:06.108750 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74492aa4-3cb9-4f76-8ac1-71d50ce6ce3e None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:06.109497 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74492aa4-3cb9-4f76-8ac1-71d50ce6ce3e None admin] RBAC: Adding query filter params (name=member) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:06.109802 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74492aa4-3cb9-4f76-8ac1-71d50ce6ce3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:06.111231 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74492aa4-3cb9-4f76-8ac1-71d50ce6ce3e None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:06.119825 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 93/175] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:37:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:06.120893 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904a035-6cc3-466f-bc8a-123877024f44 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:06.121176 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904a035-6cc3-466f-bc8a-123877024f44 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:06.121444 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6904a035-6cc3-466f-bc8a-123877024f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:06.143446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-6904a035-6cc3-466f-bc8a-123877024f44 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:06.144670 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-6904a035-6cc3-466f-bc8a-123877024f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:06.159750 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1787726c-47a0-4208-a8d0-b684db0685f5 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:06.196385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9c7bd-b87a-4d51-82a2-eb4f58e50b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:06.197038 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9c7bd-b87a-4d51-82a2-eb4f58e50b47 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:06.197318 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9c7bd-b87a-4d51-82a2-eb4f58e50b47 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:06.197585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca9c7bd-b87a-4d51-82a2-eb4f58e50b47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:06.218424 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 94/176] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:06.228121 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904a035-6cc3-466f-bc8a-123877024f44 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:06.238801 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:06.251366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:06.273910 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9c7bd-b87a-4d51-82a2-eb4f58e50b47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:06.275336 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca9c7bd-b87a-4d51-82a2-eb4f58e50b47 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:06.349563 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6904a035-6cc3-466f-bc8a-123877024f44 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:06.377920 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 83/177] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:37:06.383269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9c7bd-b87a-4d51-82a2-eb4f58e50b47 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:06.386303 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187177e-0844-4205-9b30-3472e4f7b6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:06.387310 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187177e-0844-4205-9b30-3472e4f7b6db None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:06.387734 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187177e-0844-4205-9b30-3472e4f7b6db None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:06.388161 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187177e-0844-4205-9b30-3472e4f7b6db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:06.400020 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187177e-0844-4205-9b30-3472e4f7b6db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:06.407810 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-f187177e-0844-4205-9b30-3472e4f7b6db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:37:06.407810 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:06.407810 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:06.407810 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:06.407810 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:06.407810 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:06.407810 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:06.407810 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:06.407810 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:06.407810 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:06.407810 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:06.407810 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:06.407810 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:06.407810 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:06.407810 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:06.407810 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:06.408853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:06.408853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:06.408853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:06.408853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:06.408853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:06.408853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:06.408853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:06.408853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:06.408853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:06.408853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:06.408853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:06.408853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:06.408853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:06.408853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:06.408853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:06.408853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:06.409758 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:06.409758 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:06.409758 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:06.409758 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:06.409758 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:06.409758 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:06.409758 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:06.409758 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:06.409758 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:06.409758 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:06.409758 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:37:06.409758 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:06.409758 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 95/178] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jul 2 20:37:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:06.410538 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef82ca-d7c8-4b80-9a3e-6cb32418da6f None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:06.410700 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef82ca-d7c8-4b80-9a3e-6cb32418da6f None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:06.411588 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef82ca-d7c8-4b80-9a3e-6cb32418da6f None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:06.412371 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 96/179] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:06.413069 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef82ca-d7c8-4b80-9a3e-6cb32418da6f None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:06.470014 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:06.482101 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:06.489492 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca9c7bd-b87a-4d51-82a2-eb4f58e50b47 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:06.518685 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef82ca-d7c8-4b80-9a3e-6cb32418da6f None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:06.524875 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70d87d-3401-470e-b275-e1b478c70ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:06.525476 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70d87d-3401-470e-b275-e1b478c70ec0 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:06.525761 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70d87d-3401-470e-b275-e1b478c70ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:06.526035 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70d87d-3401-470e-b275-e1b478c70ec0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:06.526857 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70d87d-3401-470e-b275-e1b478c70ec0 None admin] RBAC: Adding query filter params (role.id=538580824ccd4e02823540ee3df31cdc, scope.project.id=17380892ecb2424e932154c8ad8864b7, user.id=10854b3b3c7d41e986054d0f542ffe6e) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:06.527200 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70d87d-3401-470e-b275-e1b478c70ec0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:06.528679 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70d87d-3401-470e-b275-e1b478c70ec0 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:06.534500 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 84/180] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:37:06 2022] GET /identity/v3/role_assignments?user.id=10854b3b3c7d41e986054d0f542ffe6e&scope.project.id=17380892ecb2424e932154c8ad8864b7&role.id=538580824ccd4e02823540ee3df31cdc => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:06.535323 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70d87d-3401-470e-b275-e1b478c70ec0 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:06.560144 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4aa347-b158-42b8-8288-6ea32398c73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:06.561519 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4aa347-b158-42b8-8288-6ea32398c73f None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:06.561806 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4aa347-b158-42b8-8288-6ea32398c73f None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:06.562084 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4aa347-b158-42b8-8288-6ea32398c73f None admin] PATH_INFO: `/v3/users/10854b3b3c7d41e986054d0f542ffe6e` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:06.563835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4aa347-b158-42b8-8288-6ea32398c73f None admin] RBAC: Authorizing `identity:get_user(user_id=10854b3b3c7d41e986054d0f542ffe6e)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:06.565370 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4aa347-b158-42b8-8288-6ea32398c73f None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:06.567174 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 97/181] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:37:06 2022] GET /identity/v3/users/10854b3b3c7d41e986054d0f542ffe6e => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:06.568006 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4aa347-b158-42b8-8288-6ea32398c73f None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:06.672659 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70d87d-3401-470e-b275-e1b478c70ec0 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:06.684868 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4aa347-b158-42b8-8288-6ea32398c73f None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:06.722552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0ef4a-524e-4941-8c24-2d9f51375a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:06.724286 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0ef4a-524e-4941-8c24-2d9f51375a3e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:06.724735 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0ef4a-524e-4941-8c24-2d9f51375a3e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:06.725162 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0ef4a-524e-4941-8c24-2d9f51375a3e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:06.729682 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9c800-2f57-469c-8aaa-15060b2041d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:06.730566 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9c800-2f57-469c-8aaa-15060b2041d6 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:06.730844 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9c800-2f57-469c-8aaa-15060b2041d6 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:06.731145 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9c800-2f57-469c-8aaa-15060b2041d6 None admin] PATH_INFO: `/v3/projects/17380892ecb2424e932154c8ad8864b7` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:06.732363 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9c800-2f57-469c-8aaa-15060b2041d6 None admin] RBAC: Authorizing `identity:get_project(project_id=17380892ecb2424e932154c8ad8864b7)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:06.733853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9c800-2f57-469c-8aaa-15060b2041d6 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:06.735972 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 98/182] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:06 2022] GET /identity/v3/projects/17380892ecb2424e932154c8ad8864b7 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:06.737281 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2bba8-09e9-4574-8a6e-5985a67a955c None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:06.737570 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2bba8-09e9-4574-8a6e-5985a67a955c None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:06.737842 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2bba8-09e9-4574-8a6e-5985a67a955c None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:06.739975 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 99/183] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:06.740197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca0ef4a-524e-4941-8c24-2d9f51375a3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:06.740685 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2bba8-09e9-4574-8a6e-5985a67a955c None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:06.745007 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:06.749077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-7ca0ef4a-524e-4941-8c24-2d9f51375a3e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:37:06.749077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:06.749077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:06.749077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:06.749077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:06.749077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:06.749077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:06.749077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:06.749077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:06.749077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:06.749077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:06.749077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:06.749077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:06.749077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:06.749077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:06.749077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:06.749943 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:06.749943 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:06.749943 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:06.749943 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:06.749943 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:06.749943 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:06.749943 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:06.749943 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:06.749943 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:06.749943 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:06.749943 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:06.749943 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:06.749943 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:06.749943 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:06.749943 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:06.749943 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:06.750720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:06.750720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:06.750720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:06.750720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:06.750720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:06.750720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:06.750720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:06.750720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:06.750720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:06.750720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:06.750720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:37:06.750720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:06.750720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 85/184] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:06.756355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3da8cd-4d42-42d7-8b00-850538ca8e32 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:06.756645 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3da8cd-4d42-42d7-8b00-850538ca8e32 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:06.756915 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3da8cd-4d42-42d7-8b00-850538ca8e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:06.770146 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:06.776897 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-bc3da8cd-4d42-42d7-8b00-850538ca8e32 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:06.779031 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-bc3da8cd-4d42-42d7-8b00-850538ca8e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:06.851127 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 86/185] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:06.863197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3da8cd-4d42-42d7-8b00-850538ca8e32 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:06.863288 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2bba8-09e9-4574-8a6e-5985a67a955c None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:06.893744 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85c43f-98f9-46ee-bedc-b10399571d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:06.894419 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85c43f-98f9-46ee-bedc-b10399571d58 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:06.894700 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85c43f-98f9-46ee-bedc-b10399571d58 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:06.895005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f85c43f-98f9-46ee-bedc-b10399571d58 None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:06.895762 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85c43f-98f9-46ee-bedc-b10399571d58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:06.896073 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85c43f-98f9-46ee-bedc-b10399571d58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:06.897477 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f85c43f-98f9-46ee-bedc-b10399571d58 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:06.905830 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 100/186] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:06.906412 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85c43f-98f9-46ee-bedc-b10399571d58 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:06.948894 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3da8cd-4d42-42d7-8b00-850538ca8e32 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:06.967686 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:06.981842 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab71cd-e8df-4332-8c7a-91746fcd8ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:06.982510 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab71cd-e8df-4332-8c7a-91746fcd8ca0 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:06.982763 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab71cd-e8df-4332-8c7a-91746fcd8ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:06.983058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eab71cd-e8df-4332-8c7a-91746fcd8ca0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:06.986523 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:07.008979 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f85c43f-98f9-46ee-bedc-b10399571d58 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:07.041474 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d55856-0f21-468c-8661-546b7f3c55f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:07.042048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d55856-0f21-468c-8661-546b7f3c55f8 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:07.042320 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d55856-0f21-468c-8661-546b7f3c55f8 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:07.042591 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d55856-0f21-468c-8661-546b7f3c55f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:07.043442 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d55856-0f21-468c-8661-546b7f3c55f8 None admin] RBAC: Adding query filter params (role.id=a03f493abb6846eebc4958aabe8b28ad, scope.project.id=17380892ecb2424e932154c8ad8864b7, user.id=10854b3b3c7d41e986054d0f542ffe6e) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:07.043742 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d55856-0f21-468c-8661-546b7f3c55f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:07.045187 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d55856-0f21-468c-8661-546b7f3c55f8 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:07.050511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab71cd-e8df-4332-8c7a-91746fcd8ca0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:07.051256 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 101/187] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:37:06 2022] GET /identity/v3/role_assignments?user.id=10854b3b3c7d41e986054d0f542ffe6e&scope.project.id=17380892ecb2424e932154c8ad8864b7&role.id=a03f493abb6846eebc4958aabe8b28ad => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:07.052577 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b1352-cef7-4b66-87ee-ea95d1277a40 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:07.052863 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b1352-cef7-4b66-87ee-ea95d1277a40 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:07.053132 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b1352-cef7-4b66-87ee-ea95d1277a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:07.053226 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eab71cd-e8df-4332-8c7a-91746fcd8ca0 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:07.076978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-030b1352-cef7-4b66-87ee-ea95d1277a40 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:07.078681 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-030b1352-cef7-4b66-87ee-ea95d1277a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:07.168795 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 102/188] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:07.169288 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 87/189] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:37:07.170261 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b1352-cef7-4b66-87ee-ea95d1277a40 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:07.170367 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab71cd-e8df-4332-8c7a-91746fcd8ca0 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:07.219978 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:07.246846 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:07.298630 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b1352-cef7-4b66-87ee-ea95d1277a40 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:07.300308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eab71cd-e8df-4332-8c7a-91746fcd8ca0 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:07.338052 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3599f-5611-4fe2-9595-a6e54f71746d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:07.338735 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3599f-5611-4fe2-9595-a6e54f71746d None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:07.339055 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3599f-5611-4fe2-9595-a6e54f71746d None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:07.339332 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3599f-5611-4fe2-9595-a6e54f71746d None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:07.339590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ec6bf-1358-473c-9b9a-c358e8e2aed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:07.340201 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3599f-5611-4fe2-9595-a6e54f71746d None admin] RBAC: Adding query filter params (name=reader) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:07.340414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ec6bf-1358-473c-9b9a-c358e8e2aed5 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:07.340502 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3599f-5611-4fe2-9595-a6e54f71746d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:07.340695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ec6bf-1358-473c-9b9a-c358e8e2aed5 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:07.340963 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ec6bf-1358-473c-9b9a-c358e8e2aed5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:07.341953 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3599f-5611-4fe2-9595-a6e54f71746d None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:07.350507 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 103/190] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:37:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:07.351303 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34ec6bf-1358-473c-9b9a-c358e8e2aed5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:07.351503 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3599f-5611-4fe2-9595-a6e54f71746d None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-a34ec6bf-1358-473c-9b9a-c358e8e2aed5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:37:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:07.359644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:07.360712 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:07.360712 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:07.360712 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:07.360712 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:07.360712 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:07.360712 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:07.360712 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:07.360712 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:07.360712 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:07.360712 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:07.360712 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:07.360712 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:07.360712 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:07.360712 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:07.360712 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:07.360712 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:07.362499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:07.362499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:07.362499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:07.362499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:07.362499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:07.362499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:07.362499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:07.362499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:07.362499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:07.362499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:07.362499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:37:07.362499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:07.362499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 88/191] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jul 2 20:37:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:07.362499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ec6bf-1358-473c-9b9a-c358e8e2aed5 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:07.453067 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3599f-5611-4fe2-9595-a6e54f71746d None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:07.458221 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:07.464879 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ec6bf-1358-473c-9b9a-c358e8e2aed5 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:07.473748 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:07.489646 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f71bd2-a843-401e-882c-8f8c39149337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:07.490522 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f71bd2-a843-401e-882c-8f8c39149337 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:07.490808 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f71bd2-a843-401e-882c-8f8c39149337 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:07.491109 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f71bd2-a843-401e-882c-8f8c39149337 None admin] PATH_INFO: `/v3/users/541b68db61d94512ab6249a3008161a0` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:07.499074 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0162ef2-837a-441f-84aa-618983110ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:07.499933 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0162ef2-837a-441f-84aa-618983110ae0 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:07.500211 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0162ef2-837a-441f-84aa-618983110ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:07.500480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0162ef2-837a-441f-84aa-618983110ae0 None admin] PATH_INFO: `/v3/projects/1d43cdebf69c4cedabe6fc514bb04524` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:07.501786 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0162ef2-837a-441f-84aa-618983110ae0 None admin] RBAC: Authorizing `identity:get_project(project_id=1d43cdebf69c4cedabe6fc514bb04524)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:07.503266 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0162ef2-837a-441f-84aa-618983110ae0 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:07.504295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f71bd2-a843-401e-882c-8f8c39149337 None admin] RBAC: Authorizing `identity:get_user(user_id=541b68db61d94512ab6249a3008161a0)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:07.505131 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 89/192] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:07 2022] GET /identity/v3/projects/1d43cdebf69c4cedabe6fc514bb04524 => generated 312 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:07.505707 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0162ef2-837a-441f-84aa-618983110ae0 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:07.505786 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f71bd2-a843-401e-882c-8f8c39149337 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:07.511805 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 104/193] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:37:07 2022] GET /identity/v3/users/541b68db61d94512ab6249a3008161a0 => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:07.511805 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f71bd2-a843-401e-882c-8f8c39149337 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:07.608924 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f71bd2-a843-401e-882c-8f8c39149337 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:07.609165 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0162ef2-837a-441f-84aa-618983110ae0 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:07.642189 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534c40c-bab0-42f3-8560-989fedd4ffa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:07.642389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6b82b-af5b-4e8a-9e63-30e435699950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:07.643029 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534c40c-bab0-42f3-8560-989fedd4ffa7 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:07.643289 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6b82b-af5b-4e8a-9e63-30e435699950 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:07.643385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534c40c-bab0-42f3-8560-989fedd4ffa7 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:07.643566 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6b82b-af5b-4e8a-9e63-30e435699950 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:07.643654 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534c40c-bab0-42f3-8560-989fedd4ffa7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:07.643838 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb6b82b-af5b-4e8a-9e63-30e435699950 None admin] PATH_INFO: `/v3/users/d715d482cc234c2191f7d3253f02fff9` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:07.644759 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c534c40c-bab0-42f3-8560-989fedd4ffa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:07.645027 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6b82b-af5b-4e8a-9e63-30e435699950 None admin] RBAC: Authorizing `identity:get_user(user_id=d715d482cc234c2191f7d3253f02fff9)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:07.646226 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c534c40c-bab0-42f3-8560-989fedd4ffa7 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:07.646460 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb6b82b-af5b-4e8a-9e63-30e435699950 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:07.647895 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 90/194] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:07.648204 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 105/195] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:37:07 2022] GET /identity/v3/users/d715d482cc234c2191f7d3253f02fff9 => generated 289 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:07.649020 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6b82b-af5b-4e8a-9e63-30e435699950 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:07.651737 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534c40c-bab0-42f3-8560-989fedd4ffa7 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:07.684106 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:07.697988 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:07.752840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534c40c-bab0-42f3-8560-989fedd4ffa7 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:07.753372 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb6b82b-af5b-4e8a-9e63-30e435699950 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:07.786526 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d645b1-4bf6-4186-87ad-01f1e911dc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:07.787204 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d645b1-4bf6-4186-87ad-01f1e911dc5b None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:07.787480 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d645b1-4bf6-4186-87ad-01f1e911dc5b None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:07.787746 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d645b1-4bf6-4186-87ad-01f1e911dc5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:07.788292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481da6f-93ef-4ecf-ab26-8cc1c320f653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:07.788568 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d645b1-4bf6-4186-87ad-01f1e911dc5b None admin] RBAC: Adding query filter params (role.id=538580824ccd4e02823540ee3df31cdc, scope.project.id=1d43cdebf69c4cedabe6fc514bb04524, user.id=10854b3b3c7d41e986054d0f542ffe6e) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:07.788870 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d645b1-4bf6-4186-87ad-01f1e911dc5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:07.788956 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481da6f-93ef-4ecf-ab26-8cc1c320f653 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:07.789236 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481da6f-93ef-4ecf-ab26-8cc1c320f653 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:07.789509 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481da6f-93ef-4ecf-ab26-8cc1c320f653 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:07.790255 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481da6f-93ef-4ecf-ab26-8cc1c320f653 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:07.790339 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d645b1-4bf6-4186-87ad-01f1e911dc5b None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:07.790563 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481da6f-93ef-4ecf-ab26-8cc1c320f653 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:07.791992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481da6f-93ef-4ecf-ab26-8cc1c320f653 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:07.796309 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 106/196] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:37:07 2022] GET /identity/v3/role_assignments?user.id=10854b3b3c7d41e986054d0f542ffe6e&scope.project.id=1d43cdebf69c4cedabe6fc514bb04524&role.id=538580824ccd4e02823540ee3df31cdc => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:07.797297 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d645b1-4bf6-4186-87ad-01f1e911dc5b None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:07.807451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 91/197] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:37:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:07.808573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481da6f-93ef-4ecf-ab26-8cc1c320f653 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:07.916334 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:07.923377 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d645b1-4bf6-4186-87ad-01f1e911dc5b None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:07.924959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481da6f-93ef-4ecf-ab26-8cc1c320f653 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:07.935102 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:07.962686 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d0473-6d73-4c47-a7df-2d458ecc668a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:07.963345 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea073b-ae2a-45ad-bbdc-d9ca2d315fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:07.963848 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d0473-6d73-4c47-a7df-2d458ecc668a None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:07.964002 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea073b-ae2a-45ad-bbdc-d9ca2d315fdd None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:07.964286 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea073b-ae2a-45ad-bbdc-d9ca2d315fdd None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:07.964539 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d0473-6d73-4c47-a7df-2d458ecc668a None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:07.964641 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea073b-ae2a-45ad-bbdc-d9ca2d315fdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:07.965035 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d0473-6d73-4c47-a7df-2d458ecc668a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:08.045000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea073b-ae2a-45ad-bbdc-d9ca2d315fdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:08.045731 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d0473-6d73-4c47-a7df-2d458ecc668a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:08.046571 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea073b-ae2a-45ad-bbdc-d9ca2d315fdd None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:08.048198 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76d0473-6d73-4c47-a7df-2d458ecc668a None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:08.138026 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:08.146246 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 92/198] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:37:08.147141 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea073b-ae2a-45ad-bbdc-d9ca2d315fdd None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:08.149039 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 107/199] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:37:08.150597 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d0473-6d73-4c47-a7df-2d458ecc668a None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:08.163449 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:08.249257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea073b-ae2a-45ad-bbdc-d9ca2d315fdd None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:08.250195 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76d0473-6d73-4c47-a7df-2d458ecc668a None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:08.283788 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0002c7-7785-4526-8d6f-36259592970d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:08.283968 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f779041-25a1-4645-b4f2-5c6caea3957a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:08.284618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f779041-25a1-4645-b4f2-5c6caea3957a None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:08.284741 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0002c7-7785-4526-8d6f-36259592970d None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:08.284898 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f779041-25a1-4645-b4f2-5c6caea3957a None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:08.285000 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0002c7-7785-4526-8d6f-36259592970d None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:08.285174 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f779041-25a1-4645-b4f2-5c6caea3957a None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:08.285265 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0002c7-7785-4526-8d6f-36259592970d None admin] PATH_INFO: `/v3/users/541b68db61d94512ab6249a3008161a0` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:08.285879 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f779041-25a1-4645-b4f2-5c6caea3957a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:08.286348 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0002c7-7785-4526-8d6f-36259592970d None admin] RBAC: Authorizing `identity:get_user(user_id=541b68db61d94512ab6249a3008161a0)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:08.287362 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f779041-25a1-4645-b4f2-5c6caea3957a None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:08.287818 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0002c7-7785-4526-8d6f-36259592970d None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:08.289430 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 108/200] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:37:08 2022] GET /identity/v3/users/541b68db61d94512ab6249a3008161a0 => generated 283 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:08.290184 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0002c7-7785-4526-8d6f-36259592970d None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:08.313781 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 93/201] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jul 2 20:37:08 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:37:08.314609 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f779041-25a1-4645-b4f2-5c6caea3957a None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:08.373827 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:08.397105 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:08.421397 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0002c7-7785-4526-8d6f-36259592970d None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:08.440357 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f779041-25a1-4645-b4f2-5c6caea3957a None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:08.459394 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30746294-30c7-4508-99fc-eba1bc7a4df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:08.460286 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30746294-30c7-4508-99fc-eba1bc7a4df2 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:08.460571 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30746294-30c7-4508-99fc-eba1bc7a4df2 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:08.460859 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30746294-30c7-4508-99fc-eba1bc7a4df2 None admin] PATH_INFO: `/v3/projects/17380892ecb2424e932154c8ad8864b7` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:08.462126 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30746294-30c7-4508-99fc-eba1bc7a4df2 None admin] RBAC: Authorizing `identity:get_project(project_id=17380892ecb2424e932154c8ad8864b7)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:08.463635 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30746294-30c7-4508-99fc-eba1bc7a4df2 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:08.470293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 109/202] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:08 2022] GET /identity/v3/projects/17380892ecb2424e932154c8ad8864b7 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:08.470293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30746294-30c7-4508-99fc-eba1bc7a4df2 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:08.485992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcf800-f51c-479d-bf23-a53355c5f22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:08.487162 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcf800-f51c-479d-bf23-a53355c5f22a None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:08.487447 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcf800-f51c-479d-bf23-a53355c5f22a None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:08.487721 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcf800-f51c-479d-bf23-a53355c5f22a None admin] PATH_INFO: `/v3/projects/407b7d25a7944d3295a63d668b0a6a62` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:08.488991 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fcf800-f51c-479d-bf23-a53355c5f22a None admin] RBAC: Authorizing `identity:get_project(project_id=407b7d25a7944d3295a63d668b0a6a62)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:08.490497 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fcf800-f51c-479d-bf23-a53355c5f22a None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:08.492314 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 94/203] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:08 2022] GET /identity/v3/projects/407b7d25a7944d3295a63d668b0a6a62 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:08.497929 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcf800-f51c-479d-bf23-a53355c5f22a None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:08.590636 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30746294-30c7-4508-99fc-eba1bc7a4df2 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:08.617082 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcf800-f51c-479d-bf23-a53355c5f22a None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:08.638168 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dca02e-d5fa-4886-b1fb-8238b418d27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:08.638831 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dca02e-d5fa-4886-b1fb-8238b418d27a None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:08.639576 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dca02e-d5fa-4886-b1fb-8238b418d27a None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:08.639576 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dca02e-d5fa-4886-b1fb-8238b418d27a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:08.644993 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:08.657537 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:08.665707 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c4c8f-b939-41bb-8c95-2030e410c9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:08.666367 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c4c8f-b939-41bb-8c95-2030e410c9cb None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:08.666669 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c4c8f-b939-41bb-8c95-2030e410c9cb None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:08.668704 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c4c8f-b939-41bb-8c95-2030e410c9cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:08.668704 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c4c8f-b939-41bb-8c95-2030e410c9cb None admin] RBAC: Adding query filter params (role.id=5c2e2429808f41468c9b5a93d74645ba, scope.project.id=17380892ecb2424e932154c8ad8864b7, user.id=d715d482cc234c2191f7d3253f02fff9) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:08.668704 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c4c8f-b939-41bb-8c95-2030e410c9cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:08.669727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c4c8f-b939-41bb-8c95-2030e410c9cb None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:08.676317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 95/204] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:37:08 2022] GET /identity/v3/role_assignments?user.id=d715d482cc234c2191f7d3253f02fff9&scope.project.id=17380892ecb2424e932154c8ad8864b7&role.id=5c2e2429808f41468c9b5a93d74645ba => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:08.678989 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c4c8f-b939-41bb-8c95-2030e410c9cb None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:08.741905 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dca02e-d5fa-4886-b1fb-8238b418d27a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:08.743452 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dca02e-d5fa-4886-b1fb-8238b418d27a None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:08.847162 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c4c8f-b939-41bb-8c95-2030e410c9cb None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:08.888267 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481d4a9-c8c1-49b9-8f34-d0cf9847dedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:08.888954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481d4a9-c8c1-49b9-8f34-d0cf9847dedb None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:08.889293 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481d4a9-c8c1-49b9-8f34-d0cf9847dedb None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:08.889573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481d4a9-c8c1-49b9-8f34-d0cf9847dedb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:08.890699 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481d4a9-c8c1-49b9-8f34-d0cf9847dedb None admin] RBAC: Adding query filter params (role.id=353a58700c5640988ce2c9012e847cf8, scope.project.id=407b7d25a7944d3295a63d668b0a6a62, user.id=541b68db61d94512ab6249a3008161a0) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:08.891056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481d4a9-c8c1-49b9-8f34-d0cf9847dedb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:08.892659 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7481d4a9-c8c1-49b9-8f34-d0cf9847dedb None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:08.899695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 96/205] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:37:08 2022] GET /identity/v3/role_assignments?user.id=541b68db61d94512ab6249a3008161a0&scope.project.id=407b7d25a7944d3295a63d668b0a6a62&role.id=353a58700c5640988ce2c9012e847cf8 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:08.952312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 110/206] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:37:08.958384 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481d4a9-c8c1-49b9-8f34-d0cf9847dedb None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:09.014602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:09.087127 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481d4a9-c8c1-49b9-8f34-d0cf9847dedb None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:09.128642 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ae2fee-18d0-4bfa-a3cb-df796f74a365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:09.129442 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae2fee-18d0-4bfa-a3cb-df796f74a365 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:09.129727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae2fee-18d0-4bfa-a3cb-df796f74a365 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:09.129998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ae2fee-18d0-4bfa-a3cb-df796f74a365 None admin] PATH_INFO: `/v3/projects/407b7d25a7944d3295a63d668b0a6a62` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:09.131236 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae2fee-18d0-4bfa-a3cb-df796f74a365 None admin] RBAC: Authorizing `identity:get_project(project_id=407b7d25a7944d3295a63d668b0a6a62)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:09.132691 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ae2fee-18d0-4bfa-a3cb-df796f74a365 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:09.134565 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 97/207] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:08 2022] GET /identity/v3/projects/407b7d25a7944d3295a63d668b0a6a62 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:09.140447 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dca02e-d5fa-4886-b1fb-8238b418d27a None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:09.205706 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:09.270728 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dca02e-d5fa-4886-b1fb-8238b418d27a None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:09.307949 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d3cec-37f1-4bc4-a00b-9958e88c92c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:09.308614 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d3cec-37f1-4bc4-a00b-9958e88c92c4 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:09.308950 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d3cec-37f1-4bc4-a00b-9958e88c92c4 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:09.309227 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d3cec-37f1-4bc4-a00b-9958e88c92c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:09.310124 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d3cec-37f1-4bc4-a00b-9958e88c92c4 None admin] RBAC: Adding query filter params (role.id=a03f493abb6846eebc4958aabe8b28ad, scope.project.id=407b7d25a7944d3295a63d668b0a6a62, user.id=541b68db61d94512ab6249a3008161a0) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:09.310437 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d3cec-37f1-4bc4-a00b-9958e88c92c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:09.311925 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879d3cec-37f1-4bc4-a00b-9958e88c92c4 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:09.318893 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 111/208] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:37:09 2022] GET /identity/v3/role_assignments?user.id=541b68db61d94512ab6249a3008161a0&scope.project.id=407b7d25a7944d3295a63d668b0a6a62&role.id=a03f493abb6846eebc4958aabe8b28ad => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:10.835684 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78537d-4e77-4df7-8c9f-9253f7f84aa2 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:10.836715 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78537d-4e77-4df7-8c9f-9253f7f84aa2 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:10.837193 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78537d-4e77-4df7-8c9f-9253f7f84aa2 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:10.838791 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 98/209] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:10.844286 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0e300-2bac-4082-9166-07fdbe2c323e None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:10.845232 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0e300-2bac-4082-9166-07fdbe2c323e None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:10.845723 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0e300-2bac-4082-9166-07fdbe2c323e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:10.862948 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-feb0e300-2bac-4082-9166-07fdbe2c323e None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:10.864409 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-feb0e300-2bac-4082-9166-07fdbe2c323e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:10.933287 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 112/210] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:37:10.940790 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff256d-c360-4032-be59-5a6939db51a9 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:10.941161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff256d-c360-4032-be59-5a6939db51a9 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:10.941512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ff256d-c360-4032-be59-5a6939db51a9 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:10.942964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 99/211] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:10.948231 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827c835-b77b-49e8-9e79-a026b3ec4f26 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:10.948523 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827c835-b77b-49e8-9e79-a026b3ec4f26 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:10.948799 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827c835-b77b-49e8-9e79-a026b3ec4f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:10.965411 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff256d-c360-4032-be59-5a6939db51a9 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:10.966216 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-d827c835-b77b-49e8-9e79-a026b3ec4f26 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:10.967378 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-d827c835-b77b-49e8-9e79-a026b3ec4f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:11.009712 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:11.056049 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 113/212] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:11.082636 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827c835-b77b-49e8-9e79-a026b3ec4f26 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:11.097585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ff256d-c360-4032-be59-5a6939db51a9 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:11.119317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:11.145554 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91072478-7556-4523-9217-62ce2b29b0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:11.150701 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91072478-7556-4523-9217-62ce2b29b0d2 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:11.151126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91072478-7556-4523-9217-62ce2b29b0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:11.151904 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91072478-7556-4523-9217-62ce2b29b0d2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:11.167702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91072478-7556-4523-9217-62ce2b29b0d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:11.178472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-91072478-7556-4523-9217-62ce2b29b0d2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:11.178472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:11.178472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:11.178472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:11.178472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:11.178472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:11.178472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:11.178472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:11.178472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:11.178472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:11.178472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:11.178472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:11.178472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:11.178472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:11.178472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:11.178472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:11.179504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:11.179504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:11.179504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:11.179504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:11.179504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:11.179504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:11.179504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:11.179504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:11.179504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:11.179504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:11.179504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:11.179504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:11.179504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:11.179504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:11.179504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:11.179504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:11.180313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:11.180313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:11.180313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:11.180313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:11.180313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:11.180313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:11.180313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:11.180313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:11.180313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:11.180313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:11.180313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:11.180313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:11.187695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 100/213] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:37:11.188951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91072478-7556-4523-9217-62ce2b29b0d2 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:11.197620 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827c835-b77b-49e8-9e79-a026b3ec4f26 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:11.240945 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17aaba4-a109-4ac3-820c-2987e29c7580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:11.241674 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17aaba4-a109-4ac3-820c-2987e29c7580 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:11.241958 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17aaba4-a109-4ac3-820c-2987e29c7580 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:11.242238 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17aaba4-a109-4ac3-820c-2987e29c7580 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:11.243455 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17aaba4-a109-4ac3-820c-2987e29c7580 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:11.244917 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17aaba4-a109-4ac3-820c-2987e29c7580 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:11.246556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 114/214] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:11.252022 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17aaba4-a109-4ac3-820c-2987e29c7580 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:11.294635 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:11.303527 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91072478-7556-4523-9217-62ce2b29b0d2 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:11.339506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc1613-4f60-409f-b668-413d921d9a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:11.340209 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc1613-4f60-409f-b668-413d921d9a40 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:11.340491 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc1613-4f60-409f-b668-413d921d9a40 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:11.340806 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc1613-4f60-409f-b668-413d921d9a40 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:11.341551 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc1613-4f60-409f-b668-413d921d9a40 None admin] RBAC: Adding query filter params (name=member) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:11.341872 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc1613-4f60-409f-b668-413d921d9a40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:11.343421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc1613-4f60-409f-b668-413d921d9a40 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:11.352254 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 101/215] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:37:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:11.356868 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfe023-0416-4d88-a757-0436123da798 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:11.357313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfe023-0416-4d88-a757-0436123da798 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:11.357590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dfe023-0416-4d88-a757-0436123da798 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:11.361692 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17aaba4-a109-4ac3-820c-2987e29c7580 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:11.363381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 102/216] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:11 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:11.364214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfe023-0416-4d88-a757-0436123da798 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:11.400054 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ff63b-8383-4d03-90ee-bcc33ef4efd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:11.400745 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ff63b-8383-4d03-90ee-bcc33ef4efd9 None admin] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:11.401021 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ff63b-8383-4d03-90ee-bcc33ef4efd9 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:11.401287 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ff63b-8383-4d03-90ee-bcc33ef4efd9 None admin] PATH_INFO: `/v3/users` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:11.402125 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ff63b-8383-4d03-90ee-bcc33ef4efd9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:11.403477 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:11.404683 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ff63b-8383-4d03-90ee-bcc33ef4efd9 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:11.434945 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 115/217] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jul 2 20:37:11 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 20:37:11.434945 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4bb243-f9d0-45b7-be5c-d6dfca5856ef None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:11.434945 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4bb243-f9d0-45b7-be5c-d6dfca5856ef None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:11.434945 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4bb243-f9d0-45b7-be5c-d6dfca5856ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:11.457290 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-be4bb243-f9d0-45b7-be5c-d6dfca5856ef None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:11.458668 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-be4bb243-f9d0-45b7-be5c-d6dfca5856ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:11.492133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dfe023-0416-4d88-a757-0436123da798 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:11.534863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810e70d-5b42-42b7-aec3-6c8d6d3a9ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:11.535950 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810e70d-5b42-42b7-aec3-6c8d6d3a9ef7 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:11.536330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810e70d-5b42-42b7-aec3-6c8d6d3a9ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:11.536678 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810e70d-5b42-42b7-aec3-6c8d6d3a9ef7 None admin] PATH_INFO: `/v3/users/da5ac8e9fcb54328abf7fe174009d532` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:11.553921 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810e70d-5b42-42b7-aec3-6c8d6d3a9ef7 None admin] RBAC: Authorizing `identity:get_user(user_id=da5ac8e9fcb54328abf7fe174009d532)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:11.555585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810e70d-5b42-42b7-aec3-6c8d6d3a9ef7 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:11.557785 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 103/218] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:37:11 2022] GET /identity/v3/users/da5ac8e9fcb54328abf7fe174009d532 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:11.563221 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810e70d-5b42-42b7-aec3-6c8d6d3a9ef7 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:11.563997 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 116/219] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:11.590469 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4bb243-f9d0-45b7-be5c-d6dfca5856ef None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:11.619284 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:11.680730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:11.688646 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810e70d-5b42-42b7-aec3-6c8d6d3a9ef7 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:11.729676 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4bb243-f9d0-45b7-be5c-d6dfca5856ef None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:11.734373 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0b8aa-e562-4924-84bd-c6fc510aebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:11.737618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0b8aa-e562-4924-84bd-c6fc510aebab None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:11.737618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0b8aa-e562-4924-84bd-c6fc510aebab None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:11.737618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0b8aa-e562-4924-84bd-c6fc510aebab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:11.773244 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c193118-efda-46ea-9362-a7db1734dc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:11.773984 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c193118-efda-46ea-9362-a7db1734dc91 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:11.774262 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c193118-efda-46ea-9362-a7db1734dc91 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:11.774711 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c193118-efda-46ea-9362-a7db1734dc91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:11.785875 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c193118-efda-46ea-9362-a7db1734dc91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:11.793962 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-9c193118-efda-46ea-9362-a7db1734dc91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:37:11.793962 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:11.793962 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:11.793962 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:11.793962 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:11.793962 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:11.793962 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:11.793962 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:11.793962 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:11.793962 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:11.793962 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:11.793962 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:11.793962 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:11.793962 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:11.793962 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:11.793962 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:11.794870 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:11.794870 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:11.794870 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:11.794870 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:11.794870 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:11.794870 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:11.794870 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:11.794870 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:11.794870 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:11.794870 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:11.794870 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:11.794870 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:11.794870 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:11.794870 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:11.794870 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:11.794870 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:11.795687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:11.795687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:11.795687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:11.795687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:11.795687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:11.795687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:11.795687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:11.795687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:11.795687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:11.795687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:11.795687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:37:11.795687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:11.796301 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 117/220] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jul 2 20:37:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:11.802501 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c193118-efda-46ea-9362-a7db1734dc91 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:11.823189 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0b8aa-e562-4924-84bd-c6fc510aebab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:11.824727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0b8aa-e562-4924-84bd-c6fc510aebab None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:11.907309 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:11.928416 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c193118-efda-46ea-9362-a7db1734dc91 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:11.942350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:11.950557 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 104/221] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 02 20:37:11.954956 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb165b23-8109-4a83-b1af-a60d347b72c9 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:11.954956 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb165b23-8109-4a83-b1af-a60d347b72c9 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:11.954956 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb165b23-8109-4a83-b1af-a60d347b72c9 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:11.955352 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 105/222] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:11.960962 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4012cc-7a5e-43dd-9e52-8204ab6329e4 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:11.961254 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4012cc-7a5e-43dd-9e52-8204ab6329e4 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:11.961532 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4012cc-7a5e-43dd-9e52-8204ab6329e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:11.980737 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-dd4012cc-7a5e-43dd-9e52-8204ab6329e4 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:11.981941 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-dd4012cc-7a5e-43dd-9e52-8204ab6329e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:11.983310 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32420e30-6d03-4a2e-a5a8-ec06556b34fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:11.984496 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32420e30-6d03-4a2e-a5a8-ec06556b34fd None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:11.985958 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32420e30-6d03-4a2e-a5a8-ec06556b34fd None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:11.986505 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32420e30-6d03-4a2e-a5a8-ec06556b34fd None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:11.987540 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32420e30-6d03-4a2e-a5a8-ec06556b34fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:11.988044 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32420e30-6d03-4a2e-a5a8-ec06556b34fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:11.989668 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32420e30-6d03-4a2e-a5a8-ec06556b34fd None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:12.002307 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 118/223] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:12.007960 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32420e30-6d03-4a2e-a5a8-ec06556b34fd None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:12.063025 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 106/224] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:37:12.064902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4012cc-7a5e-43dd-9e52-8204ab6329e4 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:12.129891 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32420e30-6d03-4a2e-a5a8-ec06556b34fd None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:12.167715 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94861375-7295-4736-ad51-d0dc4b1c1f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:12.169041 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94861375-7295-4736-ad51-d0dc4b1c1f08 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:12.169603 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94861375-7295-4736-ad51-d0dc4b1c1f08 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:12.170138 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94861375-7295-4736-ad51-d0dc4b1c1f08 None admin] PATH_INFO: `/v3/projects/407b7d25a7944d3295a63d668b0a6a62` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:12.171616 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94861375-7295-4736-ad51-d0dc4b1c1f08 None admin] RBAC: Authorizing `identity:get_project(project_id=407b7d25a7944d3295a63d668b0a6a62)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:12.173979 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94861375-7295-4736-ad51-d0dc4b1c1f08 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:12.175997 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 119/225] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:12 2022] GET /identity/v3/projects/407b7d25a7944d3295a63d668b0a6a62 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:12.181727 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94861375-7295-4736-ad51-d0dc4b1c1f08 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:12.190169 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4012cc-7a5e-43dd-9e52-8204ab6329e4 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:12.200536 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:12.216225 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:12.233982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57c2e8-2986-4efa-9245-1f63e1b1a873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:12.239223 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57c2e8-2986-4efa-9245-1f63e1b1a873 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:12.240246 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57c2e8-2986-4efa-9245-1f63e1b1a873 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:12.240500 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e57c2e8-2986-4efa-9245-1f63e1b1a873 None admin] PATH_INFO: `/v3/users/541b68db61d94512ab6249a3008161a0` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:12.241891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57c2e8-2986-4efa-9245-1f63e1b1a873 None admin] RBAC: Authorizing `identity:get_user(user_id=541b68db61d94512ab6249a3008161a0)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:12.243433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e57c2e8-2986-4efa-9245-1f63e1b1a873 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:12.249598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 107/226] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:37:12 2022] GET /identity/v3/users/541b68db61d94512ab6249a3008161a0 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:12.249598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57c2e8-2986-4efa-9245-1f63e1b1a873 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:12.306140 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94861375-7295-4736-ad51-d0dc4b1c1f08 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:12.342360 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb64c28-3d42-4944-9e59-5b332db6354d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:12.343530 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb64c28-3d42-4944-9e59-5b332db6354d None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:12.343979 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb64c28-3d42-4944-9e59-5b332db6354d None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:12.344444 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb64c28-3d42-4944-9e59-5b332db6354d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:12.355120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e57c2e8-2986-4efa-9245-1f63e1b1a873 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:12.355816 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb64c28-3d42-4944-9e59-5b332db6354d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:12.364695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-7bb64c28-3d42-4944-9e59-5b332db6354d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:37:12.364695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:12.364695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:12.364695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:12.364695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:12.364695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:12.364695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:12.364695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:12.364695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:12.364695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:12.364695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:12.364695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:12.364695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:12.364695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:12.364695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:12.364695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:12.365579 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:12.365579 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:12.365579 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:12.365579 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:12.365579 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:12.365579 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:12.365579 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:12.365579 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:12.365579 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:12.365579 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:12.365579 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:12.365579 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:12.365579 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:12.365579 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:12.365579 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:12.365579 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:12.366367 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:12.366367 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:12.366367 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:12.366367 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:12.366367 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:12.366367 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:12.366367 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:12.366367 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:12.366367 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:12.366367 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:12.366367 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:37:12.366367 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:12.368914 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 120/227] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jul 2 20:37:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:12.369852 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb64c28-3d42-4944-9e59-5b332db6354d None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:12.391111 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d10aa9-210a-4b6c-a448-c9b6d6600bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:12.392087 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d10aa9-210a-4b6c-a448-c9b6d6600bac None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:12.392454 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d10aa9-210a-4b6c-a448-c9b6d6600bac None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:12.392766 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d10aa9-210a-4b6c-a448-c9b6d6600bac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:12.393667 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d10aa9-210a-4b6c-a448-c9b6d6600bac None admin] RBAC: Adding query filter params (role.id=538580824ccd4e02823540ee3df31cdc, scope.project.id=407b7d25a7944d3295a63d668b0a6a62, user.id=da5ac8e9fcb54328abf7fe174009d532) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:12.394041 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d10aa9-210a-4b6c-a448-c9b6d6600bac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:12.396207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d10aa9-210a-4b6c-a448-c9b6d6600bac None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:12.411512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 108/228] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:37:12 2022] GET /identity/v3/role_assignments?user.id=da5ac8e9fcb54328abf7fe174009d532&scope.project.id=407b7d25a7944d3295a63d668b0a6a62&role.id=538580824ccd4e02823540ee3df31cdc => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:12.411512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d10aa9-210a-4b6c-a448-c9b6d6600bac None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:12.518468 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:12.533873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:12.591507 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d10aa9-210a-4b6c-a448-c9b6d6600bac None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:12.603922 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb64c28-3d42-4944-9e59-5b332db6354d None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:12.648165 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33174d9c-d198-4fb1-96f6-36d204623953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:12.648845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33174d9c-d198-4fb1-96f6-36d204623953 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:12.649123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33174d9c-d198-4fb1-96f6-36d204623953 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:12.649396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33174d9c-d198-4fb1-96f6-36d204623953 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:12.650133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33174d9c-d198-4fb1-96f6-36d204623953 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:12.650436 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33174d9c-d198-4fb1-96f6-36d204623953 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:12.651864 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33174d9c-d198-4fb1-96f6-36d204623953 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:12.664203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 109/229] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:37:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:12.672073 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33174d9c-d198-4fb1-96f6-36d204623953 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:12.677493 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8519ac9-d470-49ce-b567-1d155ca4948f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:12.678637 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8519ac9-d470-49ce-b567-1d155ca4948f None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:12.679098 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8519ac9-d470-49ce-b567-1d155ca4948f None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:12.679514 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8519ac9-d470-49ce-b567-1d155ca4948f None admin] PATH_INFO: `/v3/projects/407b7d25a7944d3295a63d668b0a6a62` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:12.680898 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8519ac9-d470-49ce-b567-1d155ca4948f None admin] RBAC: Authorizing `identity:get_project(project_id=407b7d25a7944d3295a63d668b0a6a62)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:12.682572 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8519ac9-d470-49ce-b567-1d155ca4948f None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:12.684517 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 121/230] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:12 2022] GET /identity/v3/projects/407b7d25a7944d3295a63d668b0a6a62 => generated 302 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:12.690603 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8519ac9-d470-49ce-b567-1d155ca4948f None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:12.868321 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8519ac9-d470-49ce-b567-1d155ca4948f None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:12.869098 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33174d9c-d198-4fb1-96f6-36d204623953 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:12.904641 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:12.919935 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d8506-d385-4062-a751-b891f05dc611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:12.922416 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d8506-d385-4062-a751-b891f05dc611 None admin] REQUEST_METHOD: `PUT` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:12.922699 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d8506-d385-4062-a751-b891f05dc611 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:12.923026 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d8506-d385-4062-a751-b891f05dc611 None admin] PATH_INFO: `/v3/projects/407b7d25a7944d3295a63d668b0a6a62/users/541b68db61d94512ab6249a3008161a0/roles/353a58700c5640988ce2c9012e847cf8` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:12.929176 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d8506-d385-4062-a751-b891f05dc611 None admin] RBAC: Authorizing `identity:create_grant(project_id=407b7d25a7944d3295a63d668b0a6a62, user_id=541b68db61d94512ab6249a3008161a0, role_id=353a58700c5640988ce2c9012e847cf8)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:12.930682 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d8506-d385-4062-a751-b891f05dc611 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:12.941507 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfcea8-af36-4a4e-9662-df02371bace5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:12.942460 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfcea8-af36-4a4e-9662-df02371bace5 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:12.943006 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfcea8-af36-4a4e-9662-df02371bace5 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:12.943006 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dfcea8-af36-4a4e-9662-df02371bace5 None admin] PATH_INFO: `/v3/users/541b68db61d94512ab6249a3008161a0` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:12.944314 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dfcea8-af36-4a4e-9662-df02371bace5 None admin] RBAC: Authorizing `identity:get_user(user_id=541b68db61d94512ab6249a3008161a0)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:12.945790 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dfcea8-af36-4a4e-9662-df02371bace5 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:12.951587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 110/231] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:37:12 2022] GET /identity/v3/users/541b68db61d94512ab6249a3008161a0 => generated 283 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:12.959753 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 122/232] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jul 2 20:37:12 2022] PUT /identity/v3/projects/407b7d25a7944d3295a63d668b0a6a62/users/541b68db61d94512ab6249a3008161a0/roles/353a58700c5640988ce2c9012e847cf8 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:37:12.961151 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfcea8-af36-4a4e-9662-df02371bace5 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:13.073049 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dfcea8-af36-4a4e-9662-df02371bace5 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:13.110622 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764b7b4-b5b6-4b70-858f-73f19174925d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:13.111542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764b7b4-b5b6-4b70-858f-73f19174925d None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:13.111821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764b7b4-b5b6-4b70-858f-73f19174925d None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:13.112089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764b7b4-b5b6-4b70-858f-73f19174925d None admin] PATH_INFO: `/v3/projects/407b7d25a7944d3295a63d668b0a6a62` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:13.113313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764b7b4-b5b6-4b70-858f-73f19174925d None admin] RBAC: Authorizing `identity:get_project(project_id=407b7d25a7944d3295a63d668b0a6a62)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:13.114840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764b7b4-b5b6-4b70-858f-73f19174925d None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:13.116590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 111/233] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:12 2022] GET /identity/v3/projects/407b7d25a7944d3295a63d668b0a6a62 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:13.122437 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d8506-d385-4062-a751-b891f05dc611 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:13.125350 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:13.256885 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d8506-d385-4062-a751-b891f05dc611 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:13.295256 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e83f9a-f737-4d4d-9f7c-e3f487d10a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:13.296167 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e83f9a-f737-4d4d-9f7c-e3f487d10a9a None admin] REQUEST_METHOD: `PUT` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:13.296446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e83f9a-f737-4d4d-9f7c-e3f487d10a9a None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:13.296717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e83f9a-f737-4d4d-9f7c-e3f487d10a9a None admin] PATH_INFO: `/v3/projects/407b7d25a7944d3295a63d668b0a6a62/users/541b68db61d94512ab6249a3008161a0/roles/a03f493abb6846eebc4958aabe8b28ad` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:13.299154 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e83f9a-f737-4d4d-9f7c-e3f487d10a9a None admin] RBAC: Authorizing `identity:create_grant(project_id=407b7d25a7944d3295a63d668b0a6a62, user_id=541b68db61d94512ab6249a3008161a0, role_id=a03f493abb6846eebc4958aabe8b28ad)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:13.300613 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e83f9a-f737-4d4d-9f7c-e3f487d10a9a None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:13.317544 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 123/234] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jul 2 20:37:13 2022] PUT /identity/v3/projects/407b7d25a7944d3295a63d668b0a6a62/users/541b68db61d94512ab6249a3008161a0/roles/a03f493abb6846eebc4958aabe8b28ad => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:37:14.212825 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5e3a-744f-4a60-b784-fbba46158d93 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:14.213378 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5e3a-744f-4a60-b784-fbba46158d93 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:14.213378 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5e3a-744f-4a60-b784-fbba46158d93 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:14.215048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 112/235] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:14.219979 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8984435-0c3e-4729-99a4-ee130a3e4f09 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:14.219979 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8984435-0c3e-4729-99a4-ee130a3e4f09 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:14.220782 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8984435-0c3e-4729-99a4-ee130a3e4f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:14.230741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d977b-0deb-447d-8eca-580b81cc6eed None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:14.231065 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d977b-0deb-447d-8eca-580b81cc6eed None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:14.231349 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7d977b-0deb-447d-8eca-580b81cc6eed None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:14.232956 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 113/236] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:14.237503 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbff1f3-20ac-49d5-8ece-746d7e58cd3c None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:14.237731 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-d8984435-0c3e-4729-99a4-ee130a3e4f09 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:14.237831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbff1f3-20ac-49d5-8ece-746d7e58cd3c None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:14.238061 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbff1f3-20ac-49d5-8ece-746d7e58cd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:14.239037 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-d8984435-0c3e-4729-99a4-ee130a3e4f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:14.264319 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-4cbff1f3-20ac-49d5-8ece-746d7e58cd3c None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:14.265516 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-4cbff1f3-20ac-49d5-8ece-746d7e58cd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:14.330457 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:14.345211 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 124/237] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:14.358200 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:14.377872 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 114/238] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:14.390507 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8984435-0c3e-4729-99a4-ee130a3e4f09 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:14.405127 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbff1f3-20ac-49d5-8ece-746d7e58cd3c None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:14.511257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbff1f3-20ac-49d5-8ece-746d7e58cd3c None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:14.555932 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c792ee-ce32-41f6-b0f1-5f95db1b1e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:14.557840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c792ee-ce32-41f6-b0f1-5f95db1b1e06 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:14.558536 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c792ee-ce32-41f6-b0f1-5f95db1b1e06 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:14.560439 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c792ee-ce32-41f6-b0f1-5f95db1b1e06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:14.562947 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c792ee-ce32-41f6-b0f1-5f95db1b1e06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:14.565668 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c792ee-ce32-41f6-b0f1-5f95db1b1e06 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:14.570488 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 115/239] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:14.576909 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c792ee-ce32-41f6-b0f1-5f95db1b1e06 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:14.580313 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8984435-0c3e-4729-99a4-ee130a3e4f09 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:14.659741 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe1aa0-7a87-4611-a442-9bbd82a290ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:14.660575 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe1aa0-7a87-4611-a442-9bbd82a290ff None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:14.660853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe1aa0-7a87-4611-a442-9bbd82a290ff None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:14.661126 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe1aa0-7a87-4611-a442-9bbd82a290ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:14.661564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:14.681858 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe1aa0-7a87-4611-a442-9bbd82a290ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:14.699293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-efbe1aa0-7a87-4611-a442-9bbd82a290ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:37:14.699293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:14.699293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:14.699293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:14.699293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:14.699293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:14.699293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:14.699293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:14.699293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:14.699293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:14.699293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:14.699293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:14.699293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:14.699293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:14.699293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:14.699293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:14.700233 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:14.700233 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:14.700233 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:14.700233 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:14.700233 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:14.700233 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:14.700233 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:14.700233 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:14.700233 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:14.700233 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:14.700233 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:14.700233 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:14.700233 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:14.700233 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:14.700233 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:14.700233 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:14.701007 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:14.701007 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:14.701007 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:14.701007 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:14.701007 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:14.701007 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:14.701007 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:14.701007 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:14.701007 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:14.701007 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:14.701007 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:37:14.701007 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:14.701007 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 125/240] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:14.708560 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe1aa0-7a87-4611-a442-9bbd82a290ff None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:14.731558 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c792ee-ce32-41f6-b0f1-5f95db1b1e06 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:14.767652 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2dd5a-c245-44dd-b538-58d185712448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:14.768653 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2dd5a-c245-44dd-b538-58d185712448 None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:14.769154 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2dd5a-c245-44dd-b538-58d185712448 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:14.769614 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2dd5a-c245-44dd-b538-58d185712448 None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:14.770512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2dd5a-c245-44dd-b538-58d185712448 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:14.772186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d2dd5a-c245-44dd-b538-58d185712448 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:14.799061 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 116/241] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jul 2 20:37:14 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:37:14.833365 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:14.904972 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe1aa0-7a87-4611-a442-9bbd82a290ff None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:14.943885 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb04ef-d684-4fdd-83fc-5f2e9373fd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:14.944573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb04ef-d684-4fdd-83fc-5f2e9373fd6a None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:14.944855 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb04ef-d684-4fdd-83fc-5f2e9373fd6a None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:14.945132 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eb04ef-d684-4fdd-83fc-5f2e9373fd6a None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:14.945899 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb04ef-d684-4fdd-83fc-5f2e9373fd6a None admin] RBAC: Adding query filter params (name=reader) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:14.946209 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb04ef-d684-4fdd-83fc-5f2e9373fd6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:14.947679 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eb04ef-d684-4fdd-83fc-5f2e9373fd6a None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:14.958517 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 126/242] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:37:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:14.964230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2dd5a-c245-44dd-b538-58d185712448 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:15.121926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2dd5a-c245-44dd-b538-58d185712448 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:15.131959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:15.161186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573885de-aedd-4566-9515-3fb331c61dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:15.162085 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573885de-aedd-4566-9515-3fb331c61dcf None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:15.162367 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573885de-aedd-4566-9515-3fb331c61dcf None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:15.162645 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573885de-aedd-4566-9515-3fb331c61dcf None admin] PATH_INFO: `/v3/users/f7ed89a5cabe4cb2a9ee6c854834c780` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:15.177751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573885de-aedd-4566-9515-3fb331c61dcf None admin] RBAC: Authorizing `identity:get_user(user_id=f7ed89a5cabe4cb2a9ee6c854834c780)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:15.179290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573885de-aedd-4566-9515-3fb331c61dcf None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:15.181405 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 117/243] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:37:14 2022] GET /identity/v3/users/f7ed89a5cabe4cb2a9ee6c854834c780 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:15.186817 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb04ef-d684-4fdd-83fc-5f2e9373fd6a None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:15.305296 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eb04ef-d684-4fdd-83fc-5f2e9373fd6a None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:15.322945 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:15.332007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc7a61-40b2-43e9-ab9d-ccf07b2311ef None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:15.332508 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc7a61-40b2-43e9-ab9d-ccf07b2311ef None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:15.332584 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc7a61-40b2-43e9-ab9d-ccf07b2311ef None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:15.333941 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 118/244] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:37:15.340171 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156e95f-cc2d-4375-ba10-af2364d60804 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:15.340464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156e95f-cc2d-4375-ba10-af2364d60804 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:15.340748 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a156e95f-cc2d-4375-ba10-af2364d60804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:15.352531 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20ab47-fb01-4cc0-841f-26d348f9f1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:15.353198 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20ab47-fb01-4cc0-841f-26d348f9f1f3 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:15.353860 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20ab47-fb01-4cc0-841f-26d348f9f1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:15.353860 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20ab47-fb01-4cc0-841f-26d348f9f1f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:15.359965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-a156e95f-cc2d-4375-ba10-af2364d60804 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:15.361626 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-a156e95f-cc2d-4375-ba10-af2364d60804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:15.428276 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20ab47-fb01-4cc0-841f-26d348f9f1f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:15.429694 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d20ab47-fb01-4cc0-841f-26d348f9f1f3 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:15.461488 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 119/245] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:37:15.495437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156e95f-cc2d-4375-ba10-af2364d60804 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:15.542367 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 127/246] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 02 20:37:15.548404 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20ab47-fb01-4cc0-841f-26d348f9f1f3 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:15.568167 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:15.643934 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:15.662035 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a156e95f-cc2d-4375-ba10-af2364d60804 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:15.673373 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d20ab47-fb01-4cc0-841f-26d348f9f1f3 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:15.717637 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5610a-2eab-4bc2-b922-fb4ccd2e07c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:15.718729 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5610a-2eab-4bc2-b922-fb4ccd2e07c2 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:15.719162 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5610a-2eab-4bc2-b922-fb4ccd2e07c2 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:15.719444 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5610a-2eab-4bc2-b922-fb4ccd2e07c2 None admin] PATH_INFO: `/v3/projects/407b7d25a7944d3295a63d668b0a6a62` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:15.720908 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5610a-2eab-4bc2-b922-fb4ccd2e07c2 None admin] RBAC: Authorizing `identity:get_project(project_id=407b7d25a7944d3295a63d668b0a6a62)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:15.723122 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5610a-2eab-4bc2-b922-fb4ccd2e07c2 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:15.725542 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 128/247] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:15 2022] GET /identity/v3/projects/407b7d25a7944d3295a63d668b0a6a62 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:15.731645 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5610a-2eab-4bc2-b922-fb4ccd2e07c2 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:15.753146 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95f44b-77b9-4113-bf26-f5a7941befc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:15.754287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95f44b-77b9-4113-bf26-f5a7941befc3 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:15.754846 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95f44b-77b9-4113-bf26-f5a7941befc3 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:15.755394 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb95f44b-77b9-4113-bf26-f5a7941befc3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:15.791881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb95f44b-77b9-4113-bf26-f5a7941befc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:15.804935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-bb95f44b-77b9-4113-bf26-f5a7941befc3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:15.804935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:15.804935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:15.804935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:15.804935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:15.804935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:15.804935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:15.804935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:15.804935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:15.804935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:15.804935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:15.804935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:15.804935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:15.804935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:15.804935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:15.804935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:15.805860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:15.805860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:15.805860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:15.805860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:15.805860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:15.805860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:15.805860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:15.805860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:15.805860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:15.805860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:15.805860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:15.805860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:15.805860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:15.805860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:15.805860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:15.805860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:15.806645 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:15.806645 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:15.806645 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:15.806645 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:15.806645 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:15.806645 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:15.806645 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:15.806645 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:15.806645 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:15.806645 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:15.806645 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:15.806645 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:15.809127 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 120/248] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:15.815056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95f44b-77b9-4113-bf26-f5a7941befc3 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:15.821077 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:15.846423 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5610a-2eab-4bc2-b922-fb4ccd2e07c2 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:15.887652 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14beb86-6506-447c-ba4a-a4e7033156df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:15.888317 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14beb86-6506-447c-ba4a-a4e7033156df None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:15.888598 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14beb86-6506-447c-ba4a-a4e7033156df None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:15.888873 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14beb86-6506-447c-ba4a-a4e7033156df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:15.890598 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14beb86-6506-447c-ba4a-a4e7033156df None admin] RBAC: Adding query filter params (role.id=5c2e2429808f41468c9b5a93d74645ba, scope.project.id=407b7d25a7944d3295a63d668b0a6a62, user.id=f7ed89a5cabe4cb2a9ee6c854834c780) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:15.890944 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14beb86-6506-447c-ba4a-a4e7033156df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:15.892444 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14beb86-6506-447c-ba4a-a4e7033156df None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:15.903621 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 129/249] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:37:15 2022] GET /identity/v3/role_assignments?user.id=f7ed89a5cabe4cb2a9ee6c854834c780&scope.project.id=407b7d25a7944d3295a63d668b0a6a62&role.id=5c2e2429808f41468c9b5a93d74645ba => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:16.026382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb95f44b-77b9-4113-bf26-f5a7941befc3 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:16.079927 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcc0836-f03f-40a5-9b4c-b7f9c3b340fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:16.080784 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc0836-f03f-40a5-9b4c-b7f9c3b340fa None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:16.081063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc0836-f03f-40a5-9b4c-b7f9c3b340fa None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:16.081332 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcc0836-f03f-40a5-9b4c-b7f9c3b340fa None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:16.082101 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc0836-f03f-40a5-9b4c-b7f9c3b340fa None admin] RBAC: Adding query filter params (name=member) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:16.082402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc0836-f03f-40a5-9b4c-b7f9c3b340fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:16.083883 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcc0836-f03f-40a5-9b4c-b7f9c3b340fa None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:16.100040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 121/250] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:37:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:16.105794 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14beb86-6506-447c-ba4a-a4e7033156df None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:16.140859 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a0781-d2b2-49e6-8a28-782783fe2f36 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:16.141267 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a0781-d2b2-49e6-8a28-782783fe2f36 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:16.141501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820a0781-d2b2-49e6-8a28-782783fe2f36 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:16.143152 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 122/251] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:16.170570 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a67c4-3660-4941-b5fd-c44107ff13ea None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:16.170570 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a67c4-3660-4941-b5fd-c44107ff13ea None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:16.170570 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6a67c4-3660-4941-b5fd-c44107ff13ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:16.204178 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-8a6a67c4-3660-4941-b5fd-c44107ff13ea None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:16.205831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-8a6a67c4-3660-4941-b5fd-c44107ff13ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:16.225242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:16.233281 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14beb86-6506-447c-ba4a-a4e7033156df None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:16.271389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d0e04-3467-4ce9-b251-d46b18b9f945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:16.272274 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d0e04-3467-4ce9-b251-d46b18b9f945 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:16.272555 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d0e04-3467-4ce9-b251-d46b18b9f945 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:16.272825 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d0e04-3467-4ce9-b251-d46b18b9f945 None admin] PATH_INFO: `/v3/users/da5ac8e9fcb54328abf7fe174009d532` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:16.274032 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d0e04-3467-4ce9-b251-d46b18b9f945 None admin] RBAC: Authorizing `identity:get_user(user_id=da5ac8e9fcb54328abf7fe174009d532)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:16.275549 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d0e04-3467-4ce9-b251-d46b18b9f945 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:16.279027 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 130/252] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:37:16 2022] GET /identity/v3/users/da5ac8e9fcb54328abf7fe174009d532 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:16.287894 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d0e04-3467-4ce9-b251-d46b18b9f945 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:16.315042 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:16.345911 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 123/253] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:37:16.389717 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a67c4-3660-4941-b5fd-c44107ff13ea None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:16.433420 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d0e04-3467-4ce9-b251-d46b18b9f945 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:16.469716 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19be9a-1d95-4563-9a66-89b9b5a19515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:16.470306 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19be9a-1d95-4563-9a66-89b9b5a19515 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:16.470588 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19be9a-1d95-4563-9a66-89b9b5a19515 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:16.470857 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19be9a-1d95-4563-9a66-89b9b5a19515 None admin] PATH_INFO: `/v3/projects/407b7d25a7944d3295a63d668b0a6a62` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:16.472108 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19be9a-1d95-4563-9a66-89b9b5a19515 None admin] RBAC: Authorizing `identity:get_project(project_id=407b7d25a7944d3295a63d668b0a6a62)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:16.473589 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19be9a-1d95-4563-9a66-89b9b5a19515 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:16.475362 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 131/254] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:16 2022] GET /identity/v3/projects/407b7d25a7944d3295a63d668b0a6a62 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:16.482769 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19be9a-1d95-4563-9a66-89b9b5a19515 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:16.541496 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6a67c4-3660-4941-b5fd-c44107ff13ea None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:16.582081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe113ff-acf3-4270-b656-0adf186ec185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:16.582998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe113ff-acf3-4270-b656-0adf186ec185 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:16.583222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe113ff-acf3-4270-b656-0adf186ec185 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:16.583495 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe113ff-acf3-4270-b656-0adf186ec185 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:16.604255 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe113ff-acf3-4270-b656-0adf186ec185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:16.619432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-8fe113ff-acf3-4270-b656-0adf186ec185 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:37:16.619432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:16.619432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:16.619432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:16.619432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:16.619432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:16.619432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:16.619432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:16.619432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:16.619432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:16.619432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:16.619432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:16.619432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:16.619432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:16.619432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:16.619432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:16.620350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:16.620350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:16.620350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:16.620350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:16.620350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:16.620350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:16.620350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:16.620350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:16.620350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:16.620350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:16.620350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:16.620350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:16.620350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:16.620350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:16.620350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:16.620350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:16.621118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:16.621118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:16.621118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:16.621118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:16.621118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:16.621118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:16.621118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:16.621118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:16.621118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:16.621118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:16.621118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:37:16.621118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:16.626450 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 124/255] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jul 2 20:37:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:16.627808 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafe8b0-57da-4a3a-ab55-e37604062373 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:16.628095 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafe8b0-57da-4a3a-ab55-e37604062373 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:16.628370 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeafe8b0-57da-4a3a-ab55-e37604062373 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:16.634160 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 125/256] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:16.634949 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafe8b0-57da-4a3a-ab55-e37604062373 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:16.659517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:16.661007 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:16.682296 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19be9a-1d95-4563-9a66-89b9b5a19515 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:16.719252 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062718e-6a59-407a-bf34-9fc2cefc8062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:16.720300 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062718e-6a59-407a-bf34-9fc2cefc8062 None admin] REQUEST_METHOD: `PUT` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:16.720700 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062718e-6a59-407a-bf34-9fc2cefc8062 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:16.720980 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062718e-6a59-407a-bf34-9fc2cefc8062 None admin] PATH_INFO: `/v3/projects/407b7d25a7944d3295a63d668b0a6a62/users/da5ac8e9fcb54328abf7fe174009d532/roles/538580824ccd4e02823540ee3df31cdc` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:16.723187 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062718e-6a59-407a-bf34-9fc2cefc8062 None admin] RBAC: Authorizing `identity:create_grant(project_id=407b7d25a7944d3295a63d668b0a6a62, user_id=da5ac8e9fcb54328abf7fe174009d532, role_id=538580824ccd4e02823540ee3df31cdc)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:16.724656 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062718e-6a59-407a-bf34-9fc2cefc8062 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:16.741815 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 132/257] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jul 2 20:37:16 2022] PUT /identity/v3/projects/407b7d25a7944d3295a63d668b0a6a62/users/da5ac8e9fcb54328abf7fe174009d532/roles/538580824ccd4e02823540ee3df31cdc => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 20:37:16.743593 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c27a9d-b80d-46f5-8524-87bd29a065e5 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:16.743941 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c27a9d-b80d-46f5-8524-87bd29a065e5 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:16.744491 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c27a9d-b80d-46f5-8524-87bd29a065e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:16.765216 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-55c27a9d-b80d-46f5-8524-87bd29a065e5 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:16.766559 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-55c27a9d-b80d-46f5-8524-87bd29a065e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:16.853271 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 133/258] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:16.895724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeafe8b0-57da-4a3a-ab55-e37604062373 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:16.907254 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c27a9d-b80d-46f5-8524-87bd29a065e5 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:16.972208 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c8d40-b994-4884-9781-a2049f17f434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:16.972907 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c8d40-b994-4884-9781-a2049f17f434 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:16.973186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c8d40-b994-4884-9781-a2049f17f434 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:16.973449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c8d40-b994-4884-9781-a2049f17f434 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:16.974212 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c8d40-b994-4884-9781-a2049f17f434 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:16.974518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c8d40-b994-4884-9781-a2049f17f434 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:16.975968 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c8d40-b994-4884-9781-a2049f17f434 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:16.994360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 126/259] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:16.999402 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:17.000189 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c8d40-b994-4884-9781-a2049f17f434 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:17.040000 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c27a9d-b80d-46f5-8524-87bd29a065e5 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:17.084346 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f6e28-9120-41a4-b0a4-78d8476622ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:17.086639 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f6e28-9120-41a4-b0a4-78d8476622ae None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:17.088326 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f6e28-9120-41a4-b0a4-78d8476622ae None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:17.088765 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f6e28-9120-41a4-b0a4-78d8476622ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:17.116252 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f6e28-9120-41a4-b0a4-78d8476622ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:17.135573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-029f6e28-9120-41a4-b0a4-78d8476622ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:37:17.135573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:17.135573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:17.135573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:17.135573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:17.135573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:17.135573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:17.135573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:17.135573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:17.135573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:17.135573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:17.135573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:17.135573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:17.135573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:17.135573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:17.135573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:17.136700 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:17.136700 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:17.136700 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:17.136700 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:17.136700 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:17.136700 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:17.136700 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:17.136700 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:17.136700 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:17.136700 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:17.136700 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:17.136700 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:17.136700 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:17.136700 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:17.136700 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:17.136700 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:17.137800 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:17.137800 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:17.137800 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:17.137800 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:17.137800 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:17.137800 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:17.137800 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:17.137800 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:17.137800 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:17.137800 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:17.137800 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:37:17.137800 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:17.141832 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 134/260] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jul 2 20:37:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:37:17.147789 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f6e28-9120-41a4-b0a4-78d8476622ae None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:17.176557 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:17.216703 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c8d40-b994-4884-9781-a2049f17f434 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:17.260030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87308e-2c70-47bf-94fa-2bc0e21aa70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:17.261244 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87308e-2c70-47bf-94fa-2bc0e21aa70c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:17.261663 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87308e-2c70-47bf-94fa-2bc0e21aa70c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:17.262119 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a87308e-2c70-47bf-94fa-2bc0e21aa70c None admin] PATH_INFO: `/v3/users/541b68db61d94512ab6249a3008161a0` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:17.263541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87308e-2c70-47bf-94fa-2bc0e21aa70c None admin] RBAC: Authorizing `identity:get_user(user_id=541b68db61d94512ab6249a3008161a0)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:17.265333 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a87308e-2c70-47bf-94fa-2bc0e21aa70c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:17.267581 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 127/261] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:37:16 2022] GET /identity/v3/users/541b68db61d94512ab6249a3008161a0 => generated 283 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:17.273112 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87308e-2c70-47bf-94fa-2bc0e21aa70c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:17.302976 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f6e28-9120-41a4-b0a4-78d8476622ae None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:17.332115 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:17.333683 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5b51a-a7b2-4423-8c14-a6ffa67781d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:17.338820 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5b51a-a7b2-4423-8c14-a6ffa67781d4 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:17.338820 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5b51a-a7b2-4423-8c14-a6ffa67781d4 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:17.338820 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5b51a-a7b2-4423-8c14-a6ffa67781d4 None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:17.338820 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5b51a-a7b2-4423-8c14-a6ffa67781d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:17.338820 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5b51a-a7b2-4423-8c14-a6ffa67781d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:17.338820 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5b51a-a7b2-4423-8c14-a6ffa67781d4 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:17.347827 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 135/262] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:37:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:17.355526 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5b51a-a7b2-4423-8c14-a6ffa67781d4 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:17.515626 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5b51a-a7b2-4423-8c14-a6ffa67781d4 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:17.564065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b07cc-5118-4243-bcb8-edc24e7b173d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:17.565061 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b07cc-5118-4243-bcb8-edc24e7b173d None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:17.565343 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b07cc-5118-4243-bcb8-edc24e7b173d None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:17.565614 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b07cc-5118-4243-bcb8-edc24e7b173d None admin] PATH_INFO: `/v3/users/541b68db61d94512ab6249a3008161a0` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:17.566855 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b07cc-5118-4243-bcb8-edc24e7b173d None admin] RBAC: Authorizing `identity:get_user(user_id=541b68db61d94512ab6249a3008161a0)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:17.568546 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b07cc-5118-4243-bcb8-edc24e7b173d None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:17.569532 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a87308e-2c70-47bf-94fa-2bc0e21aa70c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:17.570193 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 136/263] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:37:17 2022] GET /identity/v3/users/541b68db61d94512ab6249a3008161a0 => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:17.576045 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b07cc-5118-4243-bcb8-edc24e7b173d None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:17.677657 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:17.704337 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0b640-1465-471a-a78e-e88d496da3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:17.705016 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0b640-1465-471a-a78e-e88d496da3ed None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:17.705296 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0b640-1465-471a-a78e-e88d496da3ed None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:17.705568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0b640-1465-471a-a78e-e88d496da3ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:17.722030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:17.765719 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b07cc-5118-4243-bcb8-edc24e7b173d None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:17.832870 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0b640-1465-471a-a78e-e88d496da3ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:17.834589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0b640-1465-471a-a78e-e88d496da3ed None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:17.859304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9888b-f5ce-4888-adb9-0a09615d33aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:17.860379 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9888b-f5ce-4888-adb9-0a09615d33aa None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:17.860861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9888b-f5ce-4888-adb9-0a09615d33aa None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:17.861298 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9888b-f5ce-4888-adb9-0a09615d33aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:18.020034 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9888b-f5ce-4888-adb9-0a09615d33aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:18.021787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9888b-f5ce-4888-adb9-0a09615d33aa None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:18.026947 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 128/264] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 752 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:37:18.034743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0b640-1465-471a-a78e-e88d496da3ed None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:18.117818 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:18.163717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:18.253604 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 137/265] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:37:18.255537 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0b640-1465-471a-a78e-e88d496da3ed None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:18.259712 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9888b-f5ce-4888-adb9-0a09615d33aa None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:18.335373 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe516954-44d9-4575-827d-f9ae5d41dc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:18.336255 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe516954-44d9-4575-827d-f9ae5d41dc9b None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:18.336535 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe516954-44d9-4575-827d-f9ae5d41dc9b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:18.336812 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe516954-44d9-4575-827d-f9ae5d41dc9b None admin] PATH_INFO: `/v3/projects/407b7d25a7944d3295a63d668b0a6a62` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:18.338178 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe516954-44d9-4575-827d-f9ae5d41dc9b None admin] RBAC: Authorizing `identity:get_project(project_id=407b7d25a7944d3295a63d668b0a6a62)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:18.339697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe516954-44d9-4575-827d-f9ae5d41dc9b None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:18.343322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 129/266] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:18 2022] GET /identity/v3/projects/407b7d25a7944d3295a63d668b0a6a62 => generated 302 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:18.352650 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe516954-44d9-4575-827d-f9ae5d41dc9b None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:18.497052 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9888b-f5ce-4888-adb9-0a09615d33aa None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:18.554022 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578efc69-44e7-4c11-9d8e-d9c88c6c15a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:18.554929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578efc69-44e7-4c11-9d8e-d9c88c6c15a2 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:18.555205 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578efc69-44e7-4c11-9d8e-d9c88c6c15a2 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:18.555478 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578efc69-44e7-4c11-9d8e-d9c88c6c15a2 None admin] PATH_INFO: `/v3/projects/407b7d25a7944d3295a63d668b0a6a62` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:18.559661 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578efc69-44e7-4c11-9d8e-d9c88c6c15a2 None admin] RBAC: Authorizing `identity:get_project(project_id=407b7d25a7944d3295a63d668b0a6a62)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:18.561138 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578efc69-44e7-4c11-9d8e-d9c88c6c15a2 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:18.563076 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 138/267] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:18 2022] GET /identity/v3/projects/407b7d25a7944d3295a63d668b0a6a62 => generated 302 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:18.568807 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578efc69-44e7-4c11-9d8e-d9c88c6c15a2 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:18.623364 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:18.652900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe516954-44d9-4575-827d-f9ae5d41dc9b None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:18.667250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:18.738541 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578efc69-44e7-4c11-9d8e-d9c88c6c15a2 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:18.742870 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20056be-cd56-41ff-b937-cc1135a74faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:18.743967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20056be-cd56-41ff-b937-cc1135a74faf None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:18.744450 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20056be-cd56-41ff-b937-cc1135a74faf None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:18.744921 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20056be-cd56-41ff-b937-cc1135a74faf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:18.746005 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20056be-cd56-41ff-b937-cc1135a74faf None admin] RBAC: Adding query filter params (role.id=353a58700c5640988ce2c9012e847cf8, scope.project.id=407b7d25a7944d3295a63d668b0a6a62, user.id=541b68db61d94512ab6249a3008161a0) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:18.746532 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20056be-cd56-41ff-b937-cc1135a74faf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:18.748447 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20056be-cd56-41ff-b937-cc1135a74faf None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:18.773419 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 130/268] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:37:18 2022] GET /identity/v3/role_assignments?user.id=541b68db61d94512ab6249a3008161a0&scope.project.id=407b7d25a7944d3295a63d668b0a6a62&role.id=353a58700c5640988ce2c9012e847cf8 => generated 608 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:18.774822 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f96a4a-9b74-4302-b130-02ee2f261e6c None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:18.775139 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f96a4a-9b74-4302-b130-02ee2f261e6c None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:18.775409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f96a4a-9b74-4302-b130-02ee2f261e6c None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:18.777049 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 131/269] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:18.778294 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f00be7-bb10-4da6-88ce-842a0bef9dd3 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:18.778572 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f00be7-bb10-4da6-88ce-842a0bef9dd3 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:18.778840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f00be7-bb10-4da6-88ce-842a0bef9dd3 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:18.780152 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 132/270] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:18.782163 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f050f47-f916-46cc-8a67-1b89270ef0ba None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:18.782547 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f050f47-f916-46cc-8a67-1b89270ef0ba None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:18.782547 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f050f47-f916-46cc-8a67-1b89270ef0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:18.789186 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa96bb-d54f-4c92-8f0b-ba6d36d1f4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:18.789896 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa96bb-d54f-4c92-8f0b-ba6d36d1f4a2 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:18.790180 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa96bb-d54f-4c92-8f0b-ba6d36d1f4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:18.790453 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa96bb-d54f-4c92-8f0b-ba6d36d1f4a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:18.791381 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa96bb-d54f-4c92-8f0b-ba6d36d1f4a2 None admin] RBAC: Adding query filter params (role.id=a03f493abb6846eebc4958aabe8b28ad, scope.project.id=407b7d25a7944d3295a63d668b0a6a62, user.id=541b68db61d94512ab6249a3008161a0) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:18.791694 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa96bb-d54f-4c92-8f0b-ba6d36d1f4a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:18.793199 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa96bb-d54f-4c92-8f0b-ba6d36d1f4a2 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:18.800876 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 139/271] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:37:18 2022] GET /identity/v3/role_assignments?user.id=541b68db61d94512ab6249a3008161a0&scope.project.id=407b7d25a7944d3295a63d668b0a6a62&role.id=a03f493abb6846eebc4958aabe8b28ad => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:18.808698 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b87180-43ae-49d5-b28b-fff92ee01d8c None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:18.809022 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b87180-43ae-49d5-b28b-fff92ee01d8c None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:18.809258 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b87180-43ae-49d5-b28b-fff92ee01d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:18.828097 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-0f050f47-f916-46cc-8a67-1b89270ef0ba None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:18.829783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-0f050f47-f916-46cc-8a67-1b89270ef0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:18.836843 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-97b87180-43ae-49d5-b28b-fff92ee01d8c None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:18.838067 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-97b87180-43ae-49d5-b28b-fff92ee01d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:19.009563 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 133/272] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:19.021835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 140/273] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:19.051682 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f050f47-f916-46cc-8a67-1b89270ef0ba None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:19.069811 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b87180-43ae-49d5-b28b-fff92ee01d8c None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:19.113292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:19.174237 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f050f47-f916-46cc-8a67-1b89270ef0ba None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:19.176694 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:19.217727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c989d-e95c-43e6-a729-4b0822b8730f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:19.218596 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c989d-e95c-43e6-a729-4b0822b8730f None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:19.218875 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c989d-e95c-43e6-a729-4b0822b8730f None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:19.219230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c989d-e95c-43e6-a729-4b0822b8730f None admin] PATH_INFO: `/v3/roles/member` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:19.229927 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b87180-43ae-49d5-b28b-fff92ee01d8c None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:19.231205 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c989d-e95c-43e6-a729-4b0822b8730f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:19.240174 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-b71c989d-e95c-43e6-a729-4b0822b8730f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:19.240174 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:19.240174 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:19.240174 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:19.240174 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:19.240174 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:19.240174 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:19.240174 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:19.240174 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:19.240174 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:19.240174 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:19.240174 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:19.240174 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:19.240174 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:19.240174 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:19.240174 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:19.241618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:19.241618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:19.241618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:19.241618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:19.241618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:19.241618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:19.241618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:19.241618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:19.241618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:19.241618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:19.241618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:19.241618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:19.241618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:19.241618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:19.241618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:19.241618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:19.242623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:19.242623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:19.242623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:19.242623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:19.242623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:19.242623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:19.242623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:19.242623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:19.242623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:19.242623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:19.242623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:19.242623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:19.242623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 134/274] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:19.247160 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd05b79-c384-4a8d-9a3f-7d15a098cf5c None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:19.247473 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd05b79-c384-4a8d-9a3f-7d15a098cf5c None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:19.247755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd05b79-c384-4a8d-9a3f-7d15a098cf5c None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:19.249146 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 135/275] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:19.251262 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd05b79-c384-4a8d-9a3f-7d15a098cf5c None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:19.283934 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05d99f-e45d-4ae0-9579-b5ccc9b1d6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:19.285086 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05d99f-e45d-4ae0-9579-b5ccc9b1d6f6 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:19.285371 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05d99f-e45d-4ae0-9579-b5ccc9b1d6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:19.285644 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05d99f-e45d-4ae0-9579-b5ccc9b1d6f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:19.287425 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05d99f-e45d-4ae0-9579-b5ccc9b1d6f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:19.290820 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05d99f-e45d-4ae0-9579-b5ccc9b1d6f6 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:19.290820 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 141/276] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:19.296141 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467b474-6300-4f6a-8d39-c4150eea398e None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:19.296427 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467b474-6300-4f6a-8d39-c4150eea398e None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:19.296703 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467b474-6300-4f6a-8d39-c4150eea398e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:19.317964 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-b467b474-6300-4f6a-8d39-c4150eea398e None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:19.319202 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-b467b474-6300-4f6a-8d39-c4150eea398e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:19.380159 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd05b79-c384-4a8d-9a3f-7d15a098cf5c None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:19.397623 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 142/277] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:19.398579 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467b474-6300-4f6a-8d39-c4150eea398e None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:19.426441 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa82c6-2584-4763-bdb1-f32c859a3000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:19.427148 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa82c6-2584-4763-bdb1-f32c859a3000 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:19.427432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa82c6-2584-4763-bdb1-f32c859a3000 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:19.427704 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa82c6-2584-4763-bdb1-f32c859a3000 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:19.428463 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa82c6-2584-4763-bdb1-f32c859a3000 None admin] RBAC: Adding query filter params (name=member) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:19.428767 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa82c6-2584-4763-bdb1-f32c859a3000 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:19.430037 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:19.430209 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faa82c6-2584-4763-bdb1-f32c859a3000 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:19.442956 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 136/278] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:37:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:19.442956 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa82c6-2584-4763-bdb1-f32c859a3000 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:19.472930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:19.521721 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467b474-6300-4f6a-8d39-c4150eea398e None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:19.557569 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faa82c6-2584-4763-bdb1-f32c859a3000 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:19.558537 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4da0ee-a0ea-439a-904b-8df9cfe3af22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:19.559247 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4da0ee-a0ea-439a-904b-8df9cfe3af22 None admin] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:19.559524 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4da0ee-a0ea-439a-904b-8df9cfe3af22 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:19.560480 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4da0ee-a0ea-439a-904b-8df9cfe3af22 None admin] PATH_INFO: `/v3/users` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:19.560480 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4da0ee-a0ea-439a-904b-8df9cfe3af22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:19.561972 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4da0ee-a0ea-439a-904b-8df9cfe3af22 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:19.594938 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 143/279] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jul 2 20:37:19 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:37:19.594938 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4da0ee-a0ea-439a-904b-8df9cfe3af22 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:19.599092 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15ed0d-819d-4897-86bb-9fa1022f6c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:19.599910 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15ed0d-819d-4897-86bb-9fa1022f6c5e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:19.600175 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15ed0d-819d-4897-86bb-9fa1022f6c5e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:19.600942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15ed0d-819d-4897-86bb-9fa1022f6c5e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:19.612561 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15ed0d-819d-4897-86bb-9fa1022f6c5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:19.620568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-ce15ed0d-819d-4897-86bb-9fa1022f6c5e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:37:19.620568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:19.620568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:19.620568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:19.620568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:19.620568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:19.620568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:19.620568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:19.620568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:19.620568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:19.620568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:19.620568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:19.620568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:19.620568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:19.620568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:19.620568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:19.621501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:19.621501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:19.621501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:19.621501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:19.621501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:19.621501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:19.621501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:19.621501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:19.621501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:19.621501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:19.621501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:19.621501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:19.621501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:19.621501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:19.621501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:19.621501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:19.622284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:19.622284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:19.622284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:19.622284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:19.622284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:19.622284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:19.622284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:19.622284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:19.622284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:19.622284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:19.622284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:37:19.622284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:19.622284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 137/280] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:19.629336 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15ed0d-819d-4897-86bb-9fa1022f6c5e None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:19.703597 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:19.735362 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4da0ee-a0ea-439a-904b-8df9cfe3af22 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:19.745240 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:19.771774 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15ed0d-819d-4897-86bb-9fa1022f6c5e None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:19.787522 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe6ce0-8a3a-4c13-ac4b-37a48fd9313f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:19.788528 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe6ce0-8a3a-4c13-ac4b-37a48fd9313f None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:19.789001 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe6ce0-8a3a-4c13-ac4b-37a48fd9313f None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:19.789276 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe6ce0-8a3a-4c13-ac4b-37a48fd9313f None admin] PATH_INFO: `/v3/users/1c7412396fca4405a2f3a995dea0d76c` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:19.808632 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe6ce0-8a3a-4c13-ac4b-37a48fd9313f None admin] RBAC: Authorizing `identity:get_user(user_id=1c7412396fca4405a2f3a995dea0d76c)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:19.810332 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe6ce0-8a3a-4c13-ac4b-37a48fd9313f None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:19.813359 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 144/281] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:37:19 2022] GET /identity/v3/users/1c7412396fca4405a2f3a995dea0d76c => generated 293 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:19.817989 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69bd95-c460-4c9e-9d0e-49d17dd0f5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:19.818137 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe6ce0-8a3a-4c13-ac4b-37a48fd9313f None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:19.818808 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69bd95-c460-4c9e-9d0e-49d17dd0f5f5 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:19.819116 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69bd95-c460-4c9e-9d0e-49d17dd0f5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:19.819389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69bd95-c460-4c9e-9d0e-49d17dd0f5f5 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:19.820151 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69bd95-c460-4c9e-9d0e-49d17dd0f5f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:19.820459 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69bd95-c460-4c9e-9d0e-49d17dd0f5f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:19.822095 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69bd95-c460-4c9e-9d0e-49d17dd0f5f5 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:19.832842 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 138/282] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:37:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:19.838493 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69bd95-c460-4c9e-9d0e-49d17dd0f5f5 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:19.942163 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe6ce0-8a3a-4c13-ac4b-37a48fd9313f None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:19.971368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69bd95-c460-4c9e-9d0e-49d17dd0f5f5 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:19.983648 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecf5d32-1103-474e-89cb-81692f968688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:19.984316 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf5d32-1103-474e-89cb-81692f968688 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:19.984597 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf5d32-1103-474e-89cb-81692f968688 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:19.984863 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecf5d32-1103-474e-89cb-81692f968688 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:19.985790 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf5d32-1103-474e-89cb-81692f968688 None admin] RBAC: Adding query filter params (role.id=538580824ccd4e02823540ee3df31cdc, user.id=1c7412396fca4405a2f3a995dea0d76c, scope.system=all) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:19.986213 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf5d32-1103-474e-89cb-81692f968688 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:19.987807 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecf5d32-1103-474e-89cb-81692f968688 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:19.991268 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:19.996976 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 145/283] 10.222.0.57 () {56 vars in 1308 bytes} [Sat Jul 2 20:37:19 2022] GET /identity/v3/role_assignments?user.id=1c7412396fca4405a2f3a995dea0d76c&scope.system=all&role.id=538580824ccd4e02823540ee3df31cdc => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:20.010838 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d47623-2656-4f01-b255-fe0463986bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:20.011803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d47623-2656-4f01-b255-fe0463986bc0 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:20.012078 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d47623-2656-4f01-b255-fe0463986bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:20.012342 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d47623-2656-4f01-b255-fe0463986bc0 None admin] PATH_INFO: `/v3/users/f7ed89a5cabe4cb2a9ee6c854834c780` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:20.013674 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d47623-2656-4f01-b255-fe0463986bc0 None admin] RBAC: Authorizing `identity:get_user(user_id=f7ed89a5cabe4cb2a9ee6c854834c780)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:20.015889 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d47623-2656-4f01-b255-fe0463986bc0 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:20.017906 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acaa95-6275-4ed1-837d-5687cbf7af1c None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:20.018778 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acaa95-6275-4ed1-837d-5687cbf7af1c None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:20.018778 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9acaa95-6275-4ed1-837d-5687cbf7af1c None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:20.020082 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 146/284] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:37:20.020635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 139/285] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:37:19 2022] GET /identity/v3/users/f7ed89a5cabe4cb2a9ee6c854834c780 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:20.026510 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acaa95-6275-4ed1-837d-5687cbf7af1c None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:20.031512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be73577-9b29-4d18-bf86-b2b4e19eaa51 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:20.031512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be73577-9b29-4d18-bf86-b2b4e19eaa51 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:20.031512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be73577-9b29-4d18-bf86-b2b4e19eaa51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:20.050525 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-0be73577-9b29-4d18-bf86-b2b4e19eaa51 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:20.052110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-0be73577-9b29-4d18-bf86-b2b4e19eaa51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:20.061212 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:20.156830 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9acaa95-6275-4ed1-837d-5687cbf7af1c None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:20.176571 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 140/286] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:37:20.196872 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d923fb3-31b0-4385-9f98-f4c5c61a9180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:20.197804 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d923fb3-31b0-4385-9f98-f4c5c61a9180 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:20.198086 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d923fb3-31b0-4385-9f98-f4c5c61a9180 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:20.198357 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d923fb3-31b0-4385-9f98-f4c5c61a9180 None admin] PATH_INFO: `/v3/projects/407b7d25a7944d3295a63d668b0a6a62` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:20.199609 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d923fb3-31b0-4385-9f98-f4c5c61a9180 None admin] RBAC: Authorizing `identity:get_project(project_id=407b7d25a7944d3295a63d668b0a6a62)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:20.201202 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d923fb3-31b0-4385-9f98-f4c5c61a9180 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:20.203692 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 147/287] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:20 2022] GET /identity/v3/projects/407b7d25a7944d3295a63d668b0a6a62 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:20.213481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be73577-9b29-4d18-bf86-b2b4e19eaa51 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:20.220465 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d923fb3-31b0-4385-9f98-f4c5c61a9180 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:20.306598 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:20.324803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be73577-9b29-4d18-bf86-b2b4e19eaa51 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:20.360192 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d923fb3-31b0-4385-9f98-f4c5c61a9180 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:20.393352 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c405911-36dc-4d29-9b39-fa1dccc1a0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:20.394713 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c405911-36dc-4d29-9b39-fa1dccc1a0cd None admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:20.395019 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c405911-36dc-4d29-9b39-fa1dccc1a0cd None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:20.395291 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c405911-36dc-4d29-9b39-fa1dccc1a0cd None admin] PATH_INFO: `/v3/projects/407b7d25a7944d3295a63d668b0a6a62/users/f7ed89a5cabe4cb2a9ee6c854834c780/roles/5c2e2429808f41468c9b5a93d74645ba` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:20.397993 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c405911-36dc-4d29-9b39-fa1dccc1a0cd None admin] RBAC: Authorizing `identity:create_grant(project_id=407b7d25a7944d3295a63d668b0a6a62, user_id=f7ed89a5cabe4cb2a9ee6c854834c780, role_id=5c2e2429808f41468c9b5a93d74645ba)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:20.399691 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c405911-36dc-4d29-9b39-fa1dccc1a0cd None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:20.416963 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 141/288] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jul 2 20:37:20 2022] PUT /identity/v3/projects/407b7d25a7944d3295a63d668b0a6a62/users/f7ed89a5cabe4cb2a9ee6c854834c780/roles/5c2e2429808f41468c9b5a93d74645ba => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:37:20.432343 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd612a-0f81-4787-9670-80bfa6b4153f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:20.433183 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd612a-0f81-4787-9670-80bfa6b4153f None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:20.433459 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd612a-0f81-4787-9670-80bfa6b4153f None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:20.433727 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadd612a-0f81-4787-9670-80bfa6b4153f None admin] PATH_INFO: `/v3/roles/member` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:20.459743 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadd612a-0f81-4787-9670-80bfa6b4153f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:20.467822 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-dadd612a-0f81-4787-9670-80bfa6b4153f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:20.467822 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:20.467822 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:20.467822 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:20.467822 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:20.467822 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:20.467822 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:20.467822 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:20.467822 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:20.467822 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:20.467822 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:20.467822 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:20.467822 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:20.467822 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:20.467822 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:20.467822 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:20.470548 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:20.470548 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:20.470548 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:20.470548 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:20.470548 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:20.470548 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:20.470548 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:20.470548 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:20.470548 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:20.470548 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:20.470548 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:20.470548 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:20.470548 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:20.470548 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:20.470548 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:20.470548 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:20.475763 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:20.475763 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:20.475763 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:20.475763 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:20.475763 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:20.475763 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:20.475763 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:20.475763 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:20.475763 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:20.475763 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:20.475763 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:20.475763 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:20.475763 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 148/289] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:37:20.480806 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c405911-36dc-4d29-9b39-fa1dccc1a0cd None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:20.497985 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:20.632722 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c405911-36dc-4d29-9b39-fa1dccc1a0cd None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:20.676913 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92514019-b3e1-4249-8dd7-a885d734fa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:20.677726 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92514019-b3e1-4249-8dd7-a885d734fa88 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:20.678153 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92514019-b3e1-4249-8dd7-a885d734fa88 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:20.678428 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92514019-b3e1-4249-8dd7-a885d734fa88 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:20.679238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92514019-b3e1-4249-8dd7-a885d734fa88 None admin] RBAC: Adding query filter params (name=member) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:20.679543 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92514019-b3e1-4249-8dd7-a885d734fa88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:20.680980 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92514019-b3e1-4249-8dd7-a885d734fa88 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:20.695344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 142/290] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:37:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:20.704220 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd612a-0f81-4787-9670-80bfa6b4153f None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:20.829329 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadd612a-0f81-4787-9670-80bfa6b4153f None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:20.858392 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:20.871673 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1107474-7080-4a92-81f8-561150182ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:20.872558 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1107474-7080-4a92-81f8-561150182ab8 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:20.872836 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1107474-7080-4a92-81f8-561150182ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:20.873107 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1107474-7080-4a92-81f8-561150182ab8 None admin] PATH_INFO: `/v3/users/da5ac8e9fcb54328abf7fe174009d532` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:20.874302 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1107474-7080-4a92-81f8-561150182ab8 None admin] RBAC: Authorizing `identity:get_user(user_id=da5ac8e9fcb54328abf7fe174009d532)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:20.875842 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1107474-7080-4a92-81f8-561150182ab8 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:20.877645 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 149/291] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:37:20 2022] GET /identity/v3/users/da5ac8e9fcb54328abf7fe174009d532 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:20.883631 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92514019-b3e1-4249-8dd7-a885d734fa88 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:20.972053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:21.018351 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92514019-b3e1-4249-8dd7-a885d734fa88 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:21.056691 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86badf-5cb7-4048-8777-3c21957b9a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:21.057346 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86badf-5cb7-4048-8777-3c21957b9a1f None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:21.057625 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86badf-5cb7-4048-8777-3c21957b9a1f None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:21.057896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d86badf-5cb7-4048-8777-3c21957b9a1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:21.144817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86badf-5cb7-4048-8777-3c21957b9a1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:21.146272 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d86badf-5cb7-4048-8777-3c21957b9a1f None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:21.223269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:21.274877 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 143/292] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:37:21.284869 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1107474-7080-4a92-81f8-561150182ab8 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:21.428095 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1107474-7080-4a92-81f8-561150182ab8 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:21.471795 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2002b72-dbac-45a3-9ffa-80e0e4e38c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:21.472662 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2002b72-dbac-45a3-9ffa-80e0e4e38c72 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:21.472945 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2002b72-dbac-45a3-9ffa-80e0e4e38c72 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:21.473218 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2002b72-dbac-45a3-9ffa-80e0e4e38c72 None admin] PATH_INFO: `/v3/projects/407b7d25a7944d3295a63d668b0a6a62` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:21.474403 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2002b72-dbac-45a3-9ffa-80e0e4e38c72 None admin] RBAC: Authorizing `identity:get_project(project_id=407b7d25a7944d3295a63d668b0a6a62)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:21.475886 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2002b72-dbac-45a3-9ffa-80e0e4e38c72 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:21.482150 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 150/293] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:21 2022] GET /identity/v3/projects/407b7d25a7944d3295a63d668b0a6a62 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:21.488034 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86badf-5cb7-4048-8777-3c21957b9a1f None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:21.600001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d86badf-5cb7-4048-8777-3c21957b9a1f None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:21.644600 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ccb0f-ca68-4db9-9952-b869b841f6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:21.645314 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ccb0f-ca68-4db9-9952-b869b841f6f4 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:21.645597 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ccb0f-ca68-4db9-9952-b869b841f6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:21.645869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ccb0f-ca68-4db9-9952-b869b841f6f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:21.646698 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ccb0f-ca68-4db9-9952-b869b841f6f4 None admin] RBAC: Adding query filter params (role.id=538580824ccd4e02823540ee3df31cdc, scope.project.id=407b7d25a7944d3295a63d668b0a6a62, user.id=da5ac8e9fcb54328abf7fe174009d532) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:21.647026 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ccb0f-ca68-4db9-9952-b869b841f6f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:21.648465 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946ccb0f-ca68-4db9-9952-b869b841f6f4 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:21.654681 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 144/294] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:37:21 2022] GET /identity/v3/role_assignments?user.id=da5ac8e9fcb54328abf7fe174009d532&scope.project.id=407b7d25a7944d3295a63d668b0a6a62&role.id=538580824ccd4e02823540ee3df31cdc => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:22.464200 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26cbce-4f74-45f1-9b38-06fb80e96bce None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:22.465241 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26cbce-4f74-45f1-9b38-06fb80e96bce None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:22.465715 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26cbce-4f74-45f1-9b38-06fb80e96bce None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:22.467555 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 151/295] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:22.472929 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409577c-f6af-4728-b62b-a0d05afac419 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:22.473763 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409577c-f6af-4728-b62b-a0d05afac419 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:22.474248 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409577c-f6af-4728-b62b-a0d05afac419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:22.491436 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-1409577c-f6af-4728-b62b-a0d05afac419 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:22.492882 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-1409577c-f6af-4728-b62b-a0d05afac419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:22.518113 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:22.570193 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 145/296] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:22.578511 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad6a59-4593-4202-8d57-cbaad3e3bd05 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:22.578882 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad6a59-4593-4202-8d57-cbaad3e3bd05 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:22.579329 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad6a59-4593-4202-8d57-cbaad3e3bd05 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:22.580693 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 152/297] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:22.585782 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21691f67-c61d-47c9-8ef4-3a566c8e801b None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:22.586080 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21691f67-c61d-47c9-8ef4-3a566c8e801b None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:22.586359 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21691f67-c61d-47c9-8ef4-3a566c8e801b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:22.595745 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad6a59-4593-4202-8d57-cbaad3e3bd05 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:22.604832 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-21691f67-c61d-47c9-8ef4-3a566c8e801b None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:22.605988 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-21691f67-c61d-47c9-8ef4-3a566c8e801b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:22.678947 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:22.688188 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 146/298] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:22.710841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21691f67-c61d-47c9-8ef4-3a566c8e801b None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:22.725789 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad6a59-4593-4202-8d57-cbaad3e3bd05 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:22.771193 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3b7f5-1bef-49bb-bb0a-eef3af2f3d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:22.772959 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3b7f5-1bef-49bb-bb0a-eef3af2f3d6f None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:22.773577 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3b7f5-1bef-49bb-bb0a-eef3af2f3d6f None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:22.774121 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3b7f5-1bef-49bb-bb0a-eef3af2f3d6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:22.775698 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3b7f5-1bef-49bb-bb0a-eef3af2f3d6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:22.777920 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3b7f5-1bef-49bb-bb0a-eef3af2f3d6f None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:22.780686 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 153/299] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:22.786647 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5cb6e-7ed3-4d15-a41f-1641e136cf1c None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:22.787065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5cb6e-7ed3-4d15-a41f-1641e136cf1c None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:22.787329 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb5cb6e-7ed3-4d15-a41f-1641e136cf1c None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:22.788896 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 154/300] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:22.790046 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5cb6e-7ed3-4d15-a41f-1641e136cf1c None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:22.807614 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:22.821372 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21691f67-c61d-47c9-8ef4-3a566c8e801b None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:22.860187 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d87ee69-dc69-446b-8d81-025fb82c7bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:22.861342 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87ee69-dc69-446b-8d81-025fb82c7bb6 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:22.861625 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87ee69-dc69-446b-8d81-025fb82c7bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:22.861903 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d87ee69-dc69-446b-8d81-025fb82c7bb6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:22.873219 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d87ee69-dc69-446b-8d81-025fb82c7bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:22.881156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-4d87ee69-dc69-446b-8d81-025fb82c7bb6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:37:22.881156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:22.881156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:22.881156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:22.881156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:22.881156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:22.881156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:22.881156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:22.881156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:22.881156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:22.881156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:22.881156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:22.881156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:22.881156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:22.881156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:22.881156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:22.882071 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:22.882071 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:22.882071 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:22.882071 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:22.882071 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:22.882071 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:22.882071 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:22.882071 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:22.882071 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:22.882071 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:22.882071 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:22.882071 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:22.882071 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:22.882071 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:22.882071 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:22.882071 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:22.882863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:22.882863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:22.882863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:22.882863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:22.882863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:22.882863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:22.882863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:22.882863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:22.882863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:22.882863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:22.882863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:37:22.882863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:22.882863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 147/301] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:37:22.883999 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababf2e8-0ecb-44c3-8680-262a30b05ef5 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:22.883999 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababf2e8-0ecb-44c3-8680-262a30b05ef5 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:22.884225 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababf2e8-0ecb-44c3-8680-262a30b05ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:22.902647 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-ababf2e8-0ecb-44c3-8680-262a30b05ef5 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:22.904145 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-ababf2e8-0ecb-44c3-8680-262a30b05ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:22.905992 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb5cb6e-7ed3-4d15-a41f-1641e136cf1c None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:22.938775 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:22.944058 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bd5dd-342e-49a4-a396-4170e6043e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:22.945568 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bd5dd-342e-49a4-a396-4170e6043e19 None admin] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:22.945860 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bd5dd-342e-49a4-a396-4170e6043e19 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:22.946140 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bd5dd-342e-49a4-a396-4170e6043e19 None admin] PATH_INFO: `/v3/groups` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:22.946840 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bd5dd-342e-49a4-a396-4170e6043e19 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:22.948423 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bd5dd-342e-49a4-a396-4170e6043e19 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:22.965517 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 155/302] 10.222.0.57 () {60 vars in 1134 bytes} [Sat Jul 2 20:37:22 2022] POST /identity/v3/groups => generated 229 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:37:22.966220 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bd5dd-342e-49a4-a396-4170e6043e19 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:23.002282 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 148/303] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:23.025046 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababf2e8-0ecb-44c3-8680-262a30b05ef5 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:23.110432 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bd5dd-342e-49a4-a396-4170e6043e19 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:23.130481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:23.156714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababf2e8-0ecb-44c3-8680-262a30b05ef5 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:23.158583 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34623c3-dbda-4c18-b929-40ecd73af954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:23.159698 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34623c3-dbda-4c18-b929-40ecd73af954 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:23.160987 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34623c3-dbda-4c18-b929-40ecd73af954 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:23.161414 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34623c3-dbda-4c18-b929-40ecd73af954 None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:23.162316 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34623c3-dbda-4c18-b929-40ecd73af954 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:23.162769 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34623c3-dbda-4c18-b929-40ecd73af954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:23.164380 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34623c3-dbda-4c18-b929-40ecd73af954 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:23.174018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 156/304] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:37:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:23.179481 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34623c3-dbda-4c18-b929-40ecd73af954 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:23.201014 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b904c73-879e-420b-b52e-d0e0000eb5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:23.201876 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b904c73-879e-420b-b52e-d0e0000eb5b9 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:23.202161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b904c73-879e-420b-b52e-d0e0000eb5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:23.202428 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b904c73-879e-420b-b52e-d0e0000eb5b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:23.223703 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b904c73-879e-420b-b52e-d0e0000eb5b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:23.232048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-8b904c73-879e-420b-b52e-d0e0000eb5b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:23.232048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:23.232048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:23.232048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:23.232048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:23.232048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:23.232048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:23.232048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:23.232048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:23.232048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:23.232048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:23.232048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:23.232048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:23.232048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:23.232048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:23.232048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:23.233003 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:23.233003 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:23.233003 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:23.233003 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:23.233003 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:23.233003 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:23.233003 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:23.233003 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:23.233003 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:23.233003 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:23.233003 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:23.233003 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:23.233003 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:23.233003 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:23.233003 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:23.233003 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:23.236397 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:23.236397 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:23.236397 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:23.236397 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:23.236397 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:23.236397 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:23.236397 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:23.236397 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:23.236397 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:23.236397 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:23.236397 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:23.236397 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:23.236397 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 149/305] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:37:23.240355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b904c73-879e-420b-b52e-d0e0000eb5b9 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:23.258593 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:23.314301 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34623c3-dbda-4c18-b929-40ecd73af954 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:23.351090 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a735f7-79a6-4dcb-8555-9d24e9e49f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:23.352139 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a735f7-79a6-4dcb-8555-9d24e9e49f06 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:23.352530 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a735f7-79a6-4dcb-8555-9d24e9e49f06 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:23.352880 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a735f7-79a6-4dcb-8555-9d24e9e49f06 None admin] PATH_INFO: `/v3/users/5f8912082fec41d1bb5266595fd6b085` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:23.365117 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b904c73-879e-420b-b52e-d0e0000eb5b9 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:23.367467 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a735f7-79a6-4dcb-8555-9d24e9e49f06 None admin] RBAC: Authorizing `identity:get_user(user_id=5f8912082fec41d1bb5266595fd6b085)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:23.368955 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a735f7-79a6-4dcb-8555-9d24e9e49f06 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:23.370954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 157/306] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:37:23 2022] GET /identity/v3/users/5f8912082fec41d1bb5266595fd6b085 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:23.376634 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a735f7-79a6-4dcb-8555-9d24e9e49f06 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:23.402443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59076922-c3b5-4e3d-be3b-08153906d374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:23.403263 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59076922-c3b5-4e3d-be3b-08153906d374 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:23.403547 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59076922-c3b5-4e3d-be3b-08153906d374 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:23.403821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59076922-c3b5-4e3d-be3b-08153906d374 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:23.404571 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59076922-c3b5-4e3d-be3b-08153906d374 None admin] RBAC: Adding query filter params (name=member) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:23.404900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59076922-c3b5-4e3d-be3b-08153906d374 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:23.406456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59076922-c3b5-4e3d-be3b-08153906d374 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:23.412965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:23.423130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 150/307] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:37:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:23.424682 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59076922-c3b5-4e3d-be3b-08153906d374 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:23.484005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a735f7-79a6-4dcb-8555-9d24e9e49f06 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:23.497698 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:23.520353 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0e9f82-3c85-47d2-ac66-f0b025ae6622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:23.521014 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9f82-3c85-47d2-ac66-f0b025ae6622 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:23.521298 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9f82-3c85-47d2-ac66-f0b025ae6622 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:23.521568 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0e9f82-3c85-47d2-ac66-f0b025ae6622 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:23.522398 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e9f82-3c85-47d2-ac66-f0b025ae6622 None admin] RBAC: Adding query filter params (role.id=5c2e2429808f41468c9b5a93d74645ba, user.id=5f8912082fec41d1bb5266595fd6b085, scope.system=all) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:23.522705 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e9f82-3c85-47d2-ac66-f0b025ae6622 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:23.524195 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0e9f82-3c85-47d2-ac66-f0b025ae6622 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:23.530282 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 158/308] 10.222.0.57 () {56 vars in 1308 bytes} [Sat Jul 2 20:37:23 2022] GET /identity/v3/role_assignments?user.id=5f8912082fec41d1bb5266595fd6b085&scope.system=all&role.id=5c2e2429808f41468c9b5a93d74645ba => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:23.531536 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e8353-1931-4843-87c4-440b9ba4c06d None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:23.531847 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e8353-1931-4843-87c4-440b9ba4c06d None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:23.532148 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906e8353-1931-4843-87c4-440b9ba4c06d None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:23.533413 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 159/309] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:23.533741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59076922-c3b5-4e3d-be3b-08153906d374 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:23.545918 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a7a46-3b61-43fd-b7cd-6ae193224db5 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:23.546545 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a7a46-3b61-43fd-b7cd-6ae193224db5 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:23.547679 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8a7a46-3b61-43fd-b7cd-6ae193224db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:23.569476 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-0e8a7a46-3b61-43fd-b7cd-6ae193224db5 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:23.570736 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-0e8a7a46-3b61-43fd-b7cd-6ae193224db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:23.585234 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101b5cf-242d-4ff2-932b-457289c537e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:23.586817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101b5cf-242d-4ff2-932b-457289c537e0 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:23.587335 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101b5cf-242d-4ff2-932b-457289c537e0 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:23.588058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101b5cf-242d-4ff2-932b-457289c537e0 None admin] PATH_INFO: `/v3/users/1c7412396fca4405a2f3a995dea0d76c` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:23.590196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101b5cf-242d-4ff2-932b-457289c537e0 None admin] RBAC: Authorizing `identity:get_user(user_id=1c7412396fca4405a2f3a995dea0d76c)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:23.592485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b101b5cf-242d-4ff2-932b-457289c537e0 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:23.595381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 151/310] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:37:23 2022] GET /identity/v3/users/1c7412396fca4405a2f3a995dea0d76c => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:23.600930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101b5cf-242d-4ff2-932b-457289c537e0 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:23.663354 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 160/311] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:37:23.683327 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a7a46-3b61-43fd-b7cd-6ae193224db5 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:23.693191 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:23.740281 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b101b5cf-242d-4ff2-932b-457289c537e0 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:23.776272 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76d19f-1c4d-4fe8-8656-686e5aa9db81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:23.777272 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76d19f-1c4d-4fe8-8656-686e5aa9db81 None admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:23.777620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76d19f-1c4d-4fe8-8656-686e5aa9db81 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:23.777962 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76d19f-1c4d-4fe8-8656-686e5aa9db81 None admin] PATH_INFO: `/v3/system/users/1c7412396fca4405a2f3a995dea0d76c/roles/538580824ccd4e02823540ee3df31cdc` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:23.779547 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76d19f-1c4d-4fe8-8656-686e5aa9db81 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1c7412396fca4405a2f3a995dea0d76c, role_id=538580824ccd4e02823540ee3df31cdc)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:23.781010 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c76d19f-1c4d-4fe8-8656-686e5aa9db81 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:23.793875 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 152/312] 10.222.0.57 () {58 vars in 1334 bytes} [Sat Jul 2 20:37:23 2022] PUT /identity/v3/system/users/1c7412396fca4405a2f3a995dea0d76c/roles/538580824ccd4e02823540ee3df31cdc => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 20:37:23.819271 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8a7a46-3b61-43fd-b7cd-6ae193224db5 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:23.829419 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:23.863192 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd16de-d528-4470-9bad-abd6bbd676a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:23.864362 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd16de-d528-4470-9bad-abd6bbd676a4 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:23.864852 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd16de-d528-4470-9bad-abd6bbd676a4 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:23.865304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd16de-d528-4470-9bad-abd6bbd676a4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:23.878355 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd16de-d528-4470-9bad-abd6bbd676a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:23.887452 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-6cfd16de-d528-4470-9bad-abd6bbd676a4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:37:23.887452 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:23.887452 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:23.887452 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:23.887452 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:23.887452 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:23.887452 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:23.887452 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:23.887452 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:23.887452 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:23.887452 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:23.887452 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:23.887452 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:23.887452 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:23.887452 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:23.887452 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:23.888512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:23.888512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:23.888512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:23.888512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:23.888512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:23.888512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:23.888512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:23.888512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:23.888512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:23.888512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:23.888512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:23.888512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:23.888512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:23.888512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:23.888512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:23.888512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:23.889296 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:23.889296 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:23.889296 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:23.889296 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:23.889296 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:23.889296 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:23.889296 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:23.889296 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:23.889296 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:23.889296 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:23.889296 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:37:23.889296 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:23.891862 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 161/313] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:23.900880 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76d19f-1c4d-4fe8-8656-686e5aa9db81 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:24.015551 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76d19f-1c4d-4fe8-8656-686e5aa9db81 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:24.046005 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:24.051669 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2b516-0242-44db-ad56-565fc2af5fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:24.052436 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2b516-0242-44db-ad56-565fc2af5fb4 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:24.052790 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2b516-0242-44db-ad56-565fc2af5fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:24.053128 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2b516-0242-44db-ad56-565fc2af5fb4 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:24.053967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2b516-0242-44db-ad56-565fc2af5fb4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:24.054605 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2b516-0242-44db-ad56-565fc2af5fb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:24.056121 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2b516-0242-44db-ad56-565fc2af5fb4 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:24.066550 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 153/314] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:37:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:24.071878 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd16de-d528-4470-9bad-abd6bbd676a4 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:24.173493 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd16de-d528-4470-9bad-abd6bbd676a4 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:24.209135 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb51c3-0901-4d38-8e60-14f519a1aac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:24.210113 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb51c3-0901-4d38-8e60-14f519a1aac7 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:24.210459 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb51c3-0901-4d38-8e60-14f519a1aac7 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:24.210796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb51c3-0901-4d38-8e60-14f519a1aac7 None admin] PATH_INFO: `/v3/users/f7ed89a5cabe4cb2a9ee6c854834c780` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:24.212128 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb51c3-0901-4d38-8e60-14f519a1aac7 None admin] RBAC: Authorizing `identity:get_user(user_id=f7ed89a5cabe4cb2a9ee6c854834c780)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:24.213669 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb51c3-0901-4d38-8e60-14f519a1aac7 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:24.215890 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 162/315] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:37:24 2022] GET /identity/v3/users/f7ed89a5cabe4cb2a9ee6c854834c780 => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:24.225402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2b516-0242-44db-ad56-565fc2af5fb4 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:24.337344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2b516-0242-44db-ad56-565fc2af5fb4 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:24.374026 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f01dd-c497-49ad-b73c-6ab3f71b5f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:24.374696 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f01dd-c497-49ad-b73c-6ab3f71b5f71 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:24.375004 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f01dd-c497-49ad-b73c-6ab3f71b5f71 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:24.375282 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990f01dd-c497-49ad-b73c-6ab3f71b5f71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:24.437838 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:24.445157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f01dd-c497-49ad-b73c-6ab3f71b5f71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:24.446661 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990f01dd-c497-49ad-b73c-6ab3f71b5f71 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:24.545663 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 154/316] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:37:24.556222 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb51c3-0901-4d38-8e60-14f519a1aac7 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:24.603857 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:24.663852 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb51c3-0901-4d38-8e60-14f519a1aac7 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:24.702040 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a38d5d-3938-43d4-97dc-d0b98df05134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:24.703265 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a38d5d-3938-43d4-97dc-d0b98df05134 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:24.703552 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a38d5d-3938-43d4-97dc-d0b98df05134 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:24.703902 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a38d5d-3938-43d4-97dc-d0b98df05134 None admin] PATH_INFO: `/v3/projects/407b7d25a7944d3295a63d668b0a6a62` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:24.705144 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a38d5d-3938-43d4-97dc-d0b98df05134 None admin] RBAC: Authorizing `identity:get_project(project_id=407b7d25a7944d3295a63d668b0a6a62)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:24.706612 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a38d5d-3938-43d4-97dc-d0b98df05134 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:24.708716 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 163/317] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:24 2022] GET /identity/v3/projects/407b7d25a7944d3295a63d668b0a6a62 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:24.718926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f01dd-c497-49ad-b73c-6ab3f71b5f71 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:24.824270 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:24.833185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990f01dd-c497-49ad-b73c-6ab3f71b5f71 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:24.870560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694c8c9-a223-4a84-8545-6cc13fea3b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:24.871214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694c8c9-a223-4a84-8545-6cc13fea3b90 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:24.871497 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694c8c9-a223-4a84-8545-6cc13fea3b90 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:24.871771 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694c8c9-a223-4a84-8545-6cc13fea3b90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:24.872656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694c8c9-a223-4a84-8545-6cc13fea3b90 None admin] RBAC: Adding query filter params (role.id=5c2e2429808f41468c9b5a93d74645ba, scope.project.id=407b7d25a7944d3295a63d668b0a6a62, user.id=f7ed89a5cabe4cb2a9ee6c854834c780) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:24.872971 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694c8c9-a223-4a84-8545-6cc13fea3b90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:24.874424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694c8c9-a223-4a84-8545-6cc13fea3b90 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:24.882070 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 155/318] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:37:24 2022] GET /identity/v3/role_assignments?user.id=f7ed89a5cabe4cb2a9ee6c854834c780&scope.project.id=407b7d25a7944d3295a63d668b0a6a62&role.id=5c2e2429808f41468c9b5a93d74645ba => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:25.401242 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e30f9-cecc-49df-aa31-03d7132f5206 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:25.401482 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e30f9-cecc-49df-aa31-03d7132f5206 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:25.401897 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e30f9-cecc-49df-aa31-03d7132f5206 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:25.403314 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 164/319] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:25.408436 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fa033-35cf-4a63-8f4a-72d69fa548ac None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:25.408797 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fa033-35cf-4a63-8f4a-72d69fa548ac None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:25.409167 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17fa033-35cf-4a63-8f4a-72d69fa548ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:25.426550 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-c17fa033-35cf-4a63-8f4a-72d69fa548ac None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:25.427797 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-c17fa033-35cf-4a63-8f4a-72d69fa548ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:25.503107 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 156/320] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:25.528353 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e30f9-cecc-49df-aa31-03d7132f5206 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:25.642659 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e30f9-cecc-49df-aa31-03d7132f5206 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:25.644218 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:25.681275 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3650a79-2093-4d7f-87c6-09772561df69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:25.681997 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3650a79-2093-4d7f-87c6-09772561df69 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:25.682298 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3650a79-2093-4d7f-87c6-09772561df69 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:25.682539 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3650a79-2093-4d7f-87c6-09772561df69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:25.683872 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3650a79-2093-4d7f-87c6-09772561df69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:25.685369 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3650a79-2093-4d7f-87c6-09772561df69 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:25.687346 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 165/321] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:25.693587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fa033-35cf-4a63-8f4a-72d69fa548ac None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:25.814654 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:25.828544 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17fa033-35cf-4a63-8f4a-72d69fa548ac None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:25.863730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3b7bf3-4fd9-4c30-a4b6-7c4a938ecf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:25.864408 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b7bf3-4fd9-4c30-a4b6-7c4a938ecf1c None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:25.864693 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b7bf3-4fd9-4c30-a4b6-7c4a938ecf1c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:25.864969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3b7bf3-4fd9-4c30-a4b6-7c4a938ecf1c None admin] PATH_INFO: `/v3/groups` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:25.865670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b7bf3-4fd9-4c30-a4b6-7c4a938ecf1c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:25.867163 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3b7bf3-4fd9-4c30-a4b6-7c4a938ecf1c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:25.889577 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 157/322] 10.222.0.57 () {60 vars in 1134 bytes} [Sat Jul 2 20:37:25 2022] POST /identity/v3/groups => generated 226 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:37:25.983199 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f19c8-a9d3-44fd-846a-ea6642c08cbe None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:25.983386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f19c8-a9d3-44fd-846a-ea6642c08cbe None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:25.983663 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f19c8-a9d3-44fd-846a-ea6642c08cbe None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:25.985171 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 166/323] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:25.991400 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7a501-3919-45d1-b36d-88191b4edb5a None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:25.991734 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7a501-3919-45d1-b36d-88191b4edb5a None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:25.991966 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca7a501-3919-45d1-b36d-88191b4edb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:26.011176 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-0ca7a501-3919-45d1-b36d-88191b4edb5a None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:26.012441 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-0ca7a501-3919-45d1-b36d-88191b4edb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:26.091422 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 158/324] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:26.115490 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f19c8-a9d3-44fd-846a-ea6642c08cbe None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:26.236652 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f19c8-a9d3-44fd-846a-ea6642c08cbe None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:26.261616 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff503702-e4c2-492d-bfea-a781e8b17b5d None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:26.261901 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff503702-e4c2-492d-bfea-a781e8b17b5d None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:26.262175 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff503702-e4c2-492d-bfea-a781e8b17b5d None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:26.263599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 159/325] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:37:26.269224 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705f503-0971-4cee-b99c-939a0929597f None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:26.269622 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705f503-0971-4cee-b99c-939a0929597f None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:26.270238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4705f503-0971-4cee-b99c-939a0929597f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:26.274014 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323692c-14e2-473c-85c7-45ffc59d75ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:26.274824 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323692c-14e2-473c-85c7-45ffc59d75ea None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:26.275179 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323692c-14e2-473c-85c7-45ffc59d75ea None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:26.275452 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323692c-14e2-473c-85c7-45ffc59d75ea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:26.286782 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323692c-14e2-473c-85c7-45ffc59d75ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:26.289584 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-4705f503-0971-4cee-b99c-939a0929597f None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:26.290769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-4705f503-0971-4cee-b99c-939a0929597f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:26.295027 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-5323692c-14e2-473c-85c7-45ffc59d75ea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:37:26.295027 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:26.295027 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:26.295027 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:26.295027 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:26.295027 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:26.295027 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:26.295027 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:26.295027 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:26.295027 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:26.295027 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:26.295027 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:26.295027 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:26.295027 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:26.295027 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:26.295027 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:26.295964 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:26.295964 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:26.295964 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:26.295964 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:26.295964 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:26.295964 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:26.295964 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:26.295964 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:26.295964 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:26.295964 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:26.295964 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:26.295964 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:26.295964 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:26.295964 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:26.295964 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:26.295964 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:26.296837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:26.296837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:26.296837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:26.296837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:26.296837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:26.296837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:26.296837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:26.296837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:26.296837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:26.296837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:26.296837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:37:26.296837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:26.296837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 167/326] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:26.301824 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323692c-14e2-473c-85c7-45ffc59d75ea None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:26.340988 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:26.384725 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 160/327] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:37:26.412382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705f503-0971-4cee-b99c-939a0929597f None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:26.427435 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:26.427928 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323692c-14e2-473c-85c7-45ffc59d75ea None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:26.477645 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f3cfa-962b-49a9-9c4b-752780e257e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:26.478335 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f3cfa-962b-49a9-9c4b-752780e257e4 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:26.478708 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f3cfa-962b-49a9-9c4b-752780e257e4 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:26.479103 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f3cfa-962b-49a9-9c4b-752780e257e4 None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:26.479949 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f3cfa-962b-49a9-9c4b-752780e257e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:26.480344 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f3cfa-962b-49a9-9c4b-752780e257e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:26.482610 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f3cfa-962b-49a9-9c4b-752780e257e4 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:26.494688 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 168/328] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:37:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:26.500157 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f3cfa-962b-49a9-9c4b-752780e257e4 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:26.537243 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4705f503-0971-4cee-b99c-939a0929597f None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:26.574617 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccb47d-de41-410b-9a2b-62025307b7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:26.576363 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccb47d-de41-410b-9a2b-62025307b7cc None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:26.576840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccb47d-de41-410b-9a2b-62025307b7cc None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:26.577295 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccb47d-de41-410b-9a2b-62025307b7cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:26.592052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ccb47d-de41-410b-9a2b-62025307b7cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:26.602456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-a0ccb47d-de41-410b-9a2b-62025307b7cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:26.602456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:26.602456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:26.602456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:26.602456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:26.602456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:26.602456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:26.602456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:26.602456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:26.602456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:26.602456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:26.602456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:26.602456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:26.602456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:26.602456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:26.602456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:26.603415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:26.603415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:26.603415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:26.603415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:26.603415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:26.603415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:26.603415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:26.603415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:26.603415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:26.603415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:26.603415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:26.603415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:26.603415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:26.603415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:26.603415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:26.603415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:26.604215 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:26.604215 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:26.604215 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:26.604215 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:26.604215 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:26.604215 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:26.604215 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:26.604215 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:26.604215 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:26.604215 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:26.604215 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:26.604215 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:26.607146 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 161/329] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:37:26.612529 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:26.613309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccb47d-de41-410b-9a2b-62025307b7cc None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:26.623429 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f3cfa-962b-49a9-9c4b-752780e257e4 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:26.659098 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72ed17-8298-46db-aa95-1edd80af01bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:26.660100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72ed17-8298-46db-aa95-1edd80af01bb None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:26.660317 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72ed17-8298-46db-aa95-1edd80af01bb None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:26.660566 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc72ed17-8298-46db-aa95-1edd80af01bb None admin] PATH_INFO: `/v3/users/5f8912082fec41d1bb5266595fd6b085` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:26.662398 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72ed17-8298-46db-aa95-1edd80af01bb None admin] RBAC: Authorizing `identity:get_user(user_id=5f8912082fec41d1bb5266595fd6b085)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:26.663486 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc72ed17-8298-46db-aa95-1edd80af01bb None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:26.666238 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 169/330] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:37:26 2022] GET /identity/v3/users/5f8912082fec41d1bb5266595fd6b085 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:26.671892 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72ed17-8298-46db-aa95-1edd80af01bb None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:26.708096 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:26.752960 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccb47d-de41-410b-9a2b-62025307b7cc None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:26.780945 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc72ed17-8298-46db-aa95-1edd80af01bb None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:26.793356 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e576dfa-4c23-4598-9736-5389aca9dfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:26.794996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e576dfa-4c23-4598-9736-5389aca9dfd1 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:26.795519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e576dfa-4c23-4598-9736-5389aca9dfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:26.796093 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e576dfa-4c23-4598-9736-5389aca9dfd1 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:26.797651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e576dfa-4c23-4598-9736-5389aca9dfd1 None admin] RBAC: Adding query filter params (name=member) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:26.798228 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e576dfa-4c23-4598-9736-5389aca9dfd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:26.799892 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e576dfa-4c23-4598-9736-5389aca9dfd1 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:26.811349 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 162/331] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:37:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:26.817216 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e576dfa-4c23-4598-9736-5389aca9dfd1 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:26.830207 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4b526-d67f-4a3a-b096-cc9c712c376e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:26.831113 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4b526-d67f-4a3a-b096-cc9c712c376e None admin] REQUEST_METHOD: `PUT` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:26.831390 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4b526-d67f-4a3a-b096-cc9c712c376e None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:26.831659 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd4b526-d67f-4a3a-b096-cc9c712c376e None admin] PATH_INFO: `/v3/system/users/5f8912082fec41d1bb5266595fd6b085/roles/5c2e2429808f41468c9b5a93d74645ba` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:26.833372 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4b526-d67f-4a3a-b096-cc9c712c376e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5f8912082fec41d1bb5266595fd6b085, role_id=5c2e2429808f41468c9b5a93d74645ba)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:26.834997 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd4b526-d67f-4a3a-b096-cc9c712c376e None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:26.845590 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 170/332] 10.222.0.57 () {58 vars in 1334 bytes} [Sat Jul 2 20:37:26 2022] PUT /identity/v3/system/users/5f8912082fec41d1bb5266595fd6b085/roles/5c2e2429808f41468c9b5a93d74645ba => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 20:37:26.936018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e576dfa-4c23-4598-9736-5389aca9dfd1 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:26.977272 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:26.984495 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab87c5d6-9619-4c4e-916e-981dd954c60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:26.986516 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87c5d6-9619-4c4e-916e-981dd954c60a None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:26.987070 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87c5d6-9619-4c4e-916e-981dd954c60a None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:26.987547 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab87c5d6-9619-4c4e-916e-981dd954c60a None admin] PATH_INFO: `/v3/users/1c7412396fca4405a2f3a995dea0d76c` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:26.989074 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87c5d6-9619-4c4e-916e-981dd954c60a None admin] RBAC: Authorizing `identity:get_user(user_id=1c7412396fca4405a2f3a995dea0d76c)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:26.990820 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab87c5d6-9619-4c4e-916e-981dd954c60a None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:26.993123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 163/333] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:37:26 2022] GET /identity/v3/users/1c7412396fca4405a2f3a995dea0d76c => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:27.000073 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4b526-d67f-4a3a-b096-cc9c712c376e None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:27.034413 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:27.126759 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd4b526-d67f-4a3a-b096-cc9c712c376e None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:27.176112 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbfc00e-ad30-4bbb-8250-6b242ce56d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:27.176778 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfc00e-ad30-4bbb-8250-6b242ce56d03 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:27.177056 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfc00e-ad30-4bbb-8250-6b242ce56d03 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:27.177331 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbfc00e-ad30-4bbb-8250-6b242ce56d03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:27.178160 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfc00e-ad30-4bbb-8250-6b242ce56d03 None admin] RBAC: Adding query filter params (role.id=538580824ccd4e02823540ee3df31cdc, user.id=1c7412396fca4405a2f3a995dea0d76c, scope.system=all) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:27.178467 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfc00e-ad30-4bbb-8250-6b242ce56d03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:27.179973 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbfc00e-ad30-4bbb-8250-6b242ce56d03 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:27.192932 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 171/334] 10.222.0.57 () {56 vars in 1308 bytes} [Sat Jul 2 20:37:26 2022] GET /identity/v3/role_assignments?user.id=1c7412396fca4405a2f3a995dea0d76c&scope.system=all&role.id=538580824ccd4e02823540ee3df31cdc => generated 510 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:28.932813 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05156191-b0e5-411c-8aea-d00786956f04 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:28.933351 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05156191-b0e5-411c-8aea-d00786956f04 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:28.933351 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05156191-b0e5-411c-8aea-d00786956f04 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:28.935026 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 164/335] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:28.940728 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076422c-e339-4918-9b8b-db4964ded674 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:28.941574 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076422c-e339-4918-9b8b-db4964ded674 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:28.942053 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076422c-e339-4918-9b8b-db4964ded674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:28.960381 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-6076422c-e339-4918-9b8b-db4964ded674 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:28.961896 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-6076422c-e339-4918-9b8b-db4964ded674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:29.031770 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 172/336] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:29.057996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05156191-b0e5-411c-8aea-d00786956f04 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:29.200061 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05156191-b0e5-411c-8aea-d00786956f04 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:29.247795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a87eb9-575c-4df7-86dd-ea66d1e448be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:29.248999 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a87eb9-575c-4df7-86dd-ea66d1e448be None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:29.249491 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a87eb9-575c-4df7-86dd-ea66d1e448be None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:29.249970 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a87eb9-575c-4df7-86dd-ea66d1e448be None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:29.261826 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a87eb9-575c-4df7-86dd-ea66d1e448be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:29.274869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-08a87eb9-575c-4df7-86dd-ea66d1e448be None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:37:29.274869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:29.274869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:29.274869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:29.274869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:29.274869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:29.274869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:29.274869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:29.274869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:29.274869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:29.274869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:29.274869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:29.274869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:29.274869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:29.274869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:29.274869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:29.275817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:29.275817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:29.275817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:29.275817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:29.275817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:29.275817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:29.275817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:29.275817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:29.275817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:29.275817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:29.275817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:29.275817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:29.275817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:29.275817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:29.275817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:29.275817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:29.276672 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:29.276672 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:29.276672 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:29.276672 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:29.276672 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:29.276672 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:29.276672 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:29.276672 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:29.276672 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:29.276672 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:29.276672 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:37:29.276672 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:29.281837 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 165/337] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jul 2 20:37:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:29.288785 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076422c-e339-4918-9b8b-db4964ded674 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:29.307072 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:29.411564 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076422c-e339-4918-9b8b-db4964ded674 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:29.447229 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6998af48-b7a3-4f59-b1e6-69b14fb54780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:29.447905 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998af48-b7a3-4f59-b1e6-69b14fb54780 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:29.448357 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998af48-b7a3-4f59-b1e6-69b14fb54780 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:29.448633 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6998af48-b7a3-4f59-b1e6-69b14fb54780 None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:29.449385 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998af48-b7a3-4f59-b1e6-69b14fb54780 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:29.449687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998af48-b7a3-4f59-b1e6-69b14fb54780 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:29.451105 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6998af48-b7a3-4f59-b1e6-69b14fb54780 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:29.460433 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 173/338] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:37:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:29.465892 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a87eb9-575c-4df7-86dd-ea66d1e448be None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:29.532385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:29.577067 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91530114-fc81-4c94-9389-b7219184cbd6 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:29.577410 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91530114-fc81-4c94-9389-b7219184cbd6 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:29.577931 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91530114-fc81-4c94-9389-b7219184cbd6 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:29.579871 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 174/339] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:37:29.587640 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a87eb9-575c-4df7-86dd-ea66d1e448be None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:29.601867 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ab036-9a0a-48c5-be17-b2d80471b6c5 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:29.602166 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ab036-9a0a-48c5-be17-b2d80471b6c5 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:29.602403 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5ab036-9a0a-48c5-be17-b2d80471b6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:29.625706 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-ae5ab036-9a0a-48c5-be17-b2d80471b6c5 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:29.626894 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-ae5ab036-9a0a-48c5-be17-b2d80471b6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:29.662028 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a864e-a9f7-4e25-9ab1-51ae2740384e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:29.662688 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a864e-a9f7-4e25-9ab1-51ae2740384e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:29.666283 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a864e-a9f7-4e25-9ab1-51ae2740384e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:29.666615 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a864e-a9f7-4e25-9ab1-51ae2740384e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:29.756842 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 175/340] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:37:29.784310 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ab036-9a0a-48c5-be17-b2d80471b6c5 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:29.789649 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:29.798883 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a864e-a9f7-4e25-9ab1-51ae2740384e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:29.800420 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a864e-a9f7-4e25-9ab1-51ae2740384e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:29.900432 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5ab036-9a0a-48c5-be17-b2d80471b6c5 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:29.914219 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:29.944486 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157b6d7-1e52-48e8-8ce1-4bf84f95de77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:29.945299 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157b6d7-1e52-48e8-8ce1-4bf84f95de77 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:29.945571 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157b6d7-1e52-48e8-8ce1-4bf84f95de77 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:29.945838 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b157b6d7-1e52-48e8-8ce1-4bf84f95de77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:29.967594 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b157b6d7-1e52-48e8-8ce1-4bf84f95de77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:29.981777 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-b157b6d7-1e52-48e8-8ce1-4bf84f95de77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:29.981777 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:29.981777 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:29.981777 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:29.981777 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:29.981777 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:29.981777 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:29.981777 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:29.981777 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:29.981777 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:29.981777 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:29.981777 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:29.981777 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:29.981777 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:29.981777 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:29.981777 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:29.982705 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:29.982705 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:29.982705 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:29.982705 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:29.982705 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:29.982705 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:29.982705 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:29.982705 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:29.982705 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:29.982705 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:29.982705 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:29.982705 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:29.982705 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:29.982705 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:29.982705 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:29.982705 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:29.983561 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:29.983561 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:29.983561 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:29.983561 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:29.983561 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:29.983561 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:29.983561 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:29.983561 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:29.983561 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:29.983561 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:29.983561 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:29.983561 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:29.983561 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 176/341] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:37:29.991672 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157b6d7-1e52-48e8-8ce1-4bf84f95de77 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:30.007460 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 166/342] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:37:30.032571 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a864e-a9f7-4e25-9ab1-51ae2740384e None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:30.078091 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:30.162062 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b157b6d7-1e52-48e8-8ce1-4bf84f95de77 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:30.207616 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd82147-6139-4218-9fc4-fd8600f022ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:30.208353 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd82147-6139-4218-9fc4-fd8600f022ca None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:30.208630 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd82147-6139-4218-9fc4-fd8600f022ca None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:30.208902 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd82147-6139-4218-9fc4-fd8600f022ca None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:30.209648 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd82147-6139-4218-9fc4-fd8600f022ca None admin] RBAC: Adding query filter params (name=member) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:30.209950 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd82147-6139-4218-9fc4-fd8600f022ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:30.211392 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd82147-6139-4218-9fc4-fd8600f022ca None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:30.226855 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 177/343] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:37:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:30.230154 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19306584-9696-4696-babd-1812792ff420 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:30.230438 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19306584-9696-4696-babd-1812792ff420 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:30.230708 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19306584-9696-4696-babd-1812792ff420 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:30.240111 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 178/344] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:30.240973 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19306584-9696-4696-babd-1812792ff420 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:30.243475 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a864e-a9f7-4e25-9ab1-51ae2740384e None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:30.317095 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0dd94-8477-4904-bf2b-becdbe5f51a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:30.317985 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0dd94-8477-4904-bf2b-becdbe5f51a7 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:30.318266 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0dd94-8477-4904-bf2b-becdbe5f51a7 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:30.318539 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0dd94-8477-4904-bf2b-becdbe5f51a7 None admin] PATH_INFO: `/v3/projects/17380892ecb2424e932154c8ad8864b7` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:30.319786 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0dd94-8477-4904-bf2b-becdbe5f51a7 None admin] RBAC: Authorizing `identity:get_project(project_id=17380892ecb2424e932154c8ad8864b7)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:30.321241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0dd94-8477-4904-bf2b-becdbe5f51a7 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:30.323154 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 167/345] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:30 2022] GET /identity/v3/projects/17380892ecb2424e932154c8ad8864b7 => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:30.330890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dea3b-7ea5-46d5-8aee-b4892ef7d123 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:30.331153 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dea3b-7ea5-46d5-8aee-b4892ef7d123 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:30.331409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553dea3b-7ea5-46d5-8aee-b4892ef7d123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:30.367511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-553dea3b-7ea5-46d5-8aee-b4892ef7d123 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:30.368733 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-553dea3b-7ea5-46d5-8aee-b4892ef7d123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:30.418732 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:30.440338 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19306584-9696-4696-babd-1812792ff420 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:30.485380 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:30.489294 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 168/346] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:30.490420 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dea3b-7ea5-46d5-8aee-b4892ef7d123 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:30.503674 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018d0a1-c406-4492-b6a0-b5332eb9c459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:30.504691 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018d0a1-c406-4492-b6a0-b5332eb9c459 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:30.505169 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018d0a1-c406-4492-b6a0-b5332eb9c459 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:30.505662 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4018d0a1-c406-4492-b6a0-b5332eb9c459 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:30.593189 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018d0a1-c406-4492-b6a0-b5332eb9c459 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:30.595167 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4018d0a1-c406-4492-b6a0-b5332eb9c459 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:30.631433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553dea3b-7ea5-46d5-8aee-b4892ef7d123 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:30.672953 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79142a6f-77ed-42b0-8222-2c0ef780d20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:30.674773 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79142a6f-77ed-42b0-8222-2c0ef780d20d None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:30.675292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79142a6f-77ed-42b0-8222-2c0ef780d20d None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:30.675796 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79142a6f-77ed-42b0-8222-2c0ef780d20d None admin] PATH_INFO: `/v3/groups/848f16a4feb14c9685410c9f306b2938` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:30.685847 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79142a6f-77ed-42b0-8222-2c0ef780d20d None admin] RBAC: Authorizing `identity:get_group(group_id=848f16a4feb14c9685410c9f306b2938)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:30.687749 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79142a6f-77ed-42b0-8222-2c0ef780d20d None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:30.690639 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 169/347] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jul 2 20:37:30 2022] GET /identity/v3/groups/848f16a4feb14c9685410c9f306b2938 => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:30.692277 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba5a90-a495-4bd7-81bd-80b9dbd3d4f4 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:30.693175 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba5a90-a495-4bd7-81bd-80b9dbd3d4f4 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:30.700365 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cba5a90-a495-4bd7-81bd-80b9dbd3d4f4 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:30.707585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 170/348] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:30 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:30.708723 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba5a90-a495-4bd7-81bd-80b9dbd3d4f4 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:30.728296 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 179/349] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:37:30.729378 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018d0a1-c406-4492-b6a0-b5332eb9c459 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:30.742221 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:30.791308 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:30.864019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4018d0a1-c406-4492-b6a0-b5332eb9c459 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:30.885689 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cba5a90-a495-4bd7-81bd-80b9dbd3d4f4 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:30.911822 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd324c23-4478-41f3-a02d-8712438c2076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:30.912227 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd324c23-4478-41f3-a02d-8712438c2076 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:30.912505 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd324c23-4478-41f3-a02d-8712438c2076 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:30.912776 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd324c23-4478-41f3-a02d-8712438c2076 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:30.913616 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd324c23-4478-41f3-a02d-8712438c2076 None admin] RBAC: Adding query filter params (group.id=848f16a4feb14c9685410c9f306b2938, role.id=a03f493abb6846eebc4958aabe8b28ad, scope.project.id=17380892ecb2424e932154c8ad8864b7) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:30.913924 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd324c23-4478-41f3-a02d-8712438c2076 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:30.915415 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd324c23-4478-41f3-a02d-8712438c2076 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:30.926983 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 180/350] 10.222.0.57 () {56 vars in 1376 bytes} [Sat Jul 2 20:37:30 2022] GET /identity/v3/role_assignments?group.id=848f16a4feb14c9685410c9f306b2938&scope.project.id=17380892ecb2424e932154c8ad8864b7&role.id=a03f493abb6846eebc4958aabe8b28ad => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:30.926983 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acccf49-39fc-4899-8286-6d74fe6b85c6 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:30.926983 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acccf49-39fc-4899-8286-6d74fe6b85c6 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:30.926983 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acccf49-39fc-4899-8286-6d74fe6b85c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:30.956612 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-2acccf49-39fc-4899-8286-6d74fe6b85c6 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:30.957847 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-2acccf49-39fc-4899-8286-6d74fe6b85c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:30.962303 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ee7b6-dadd-40f1-aecf-48252074e387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:30.963196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ee7b6-dadd-40f1-aecf-48252074e387 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:30.963444 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ee7b6-dadd-40f1-aecf-48252074e387 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:30.963713 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ee7b6-dadd-40f1-aecf-48252074e387 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:30.987999 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ee7b6-dadd-40f1-aecf-48252074e387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:30.997772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-499ee7b6-dadd-40f1-aecf-48252074e387 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:37:30.997772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:30.997772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:30.997772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:30.997772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:30.997772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:30.997772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:30.997772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:30.997772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:30.997772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:30.997772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:30.997772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:30.997772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:30.997772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:30.997772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:30.997772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:30.998967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:30.998967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:30.998967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:30.998967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:30.998967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:30.998967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:30.998967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:30.998967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:30.998967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:30.998967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:30.998967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:30.998967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:30.998967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:30.998967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:30.998967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:30.998967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:30.999967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:30.999967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:30.999967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:30.999967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:30.999967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:30.999967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:30.999967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:30.999967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:30.999967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:30.999967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:30.999967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 02 20:37:30.999967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:31.008572 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 171/351] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:31.011576 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ee7b6-dadd-40f1-aecf-48252074e387 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:31.121154 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 181/352] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:31.122022 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acccf49-39fc-4899-8286-6d74fe6b85c6 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:31.149589 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:31.162659 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:31.191112 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ee7b6-dadd-40f1-aecf-48252074e387 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:31.239096 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63aea8b-825e-4f18-be4e-eff73138b460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:31.240578 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63aea8b-825e-4f18-be4e-eff73138b460 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:31.241441 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63aea8b-825e-4f18-be4e-eff73138b460 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:31.242173 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63aea8b-825e-4f18-be4e-eff73138b460 None admin] PATH_INFO: `/v3/projects/17380892ecb2424e932154c8ad8864b7` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:31.243806 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63aea8b-825e-4f18-be4e-eff73138b460 None admin] RBAC: Authorizing `identity:get_project(project_id=17380892ecb2424e932154c8ad8864b7)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:31.246095 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63aea8b-825e-4f18-be4e-eff73138b460 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:31.249232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 172/353] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:31 2022] GET /identity/v3/projects/17380892ecb2424e932154c8ad8864b7 => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:31.250241 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acccf49-39fc-4899-8286-6d74fe6b85c6 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:31.250991 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d5174-f5d1-474c-92c1-e1520aee1fe2 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:31.251444 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d5174-f5d1-474c-92c1-e1520aee1fe2 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:31.252130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d5174-f5d1-474c-92c1-e1520aee1fe2 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:31.254727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 173/354] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:31.255636 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d5174-f5d1-474c-92c1-e1520aee1fe2 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:31.297629 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e7b1b-1470-4cb9-a0da-205743aa0a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:31.298536 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e7b1b-1470-4cb9-a0da-205743aa0a0f None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:31.298823 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e7b1b-1470-4cb9-a0da-205743aa0a0f None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:31.299117 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e7b1b-1470-4cb9-a0da-205743aa0a0f None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:31.300331 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e7b1b-1470-4cb9-a0da-205743aa0a0f None admin] RBAC: Adding query filter params (name=reader) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:31.300645 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e7b1b-1470-4cb9-a0da-205743aa0a0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:31.302328 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e7b1b-1470-4cb9-a0da-205743aa0a0f None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:31.314978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 182/355] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:37:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:31.316184 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e7b1b-1470-4cb9-a0da-205743aa0a0f None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:31.402472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d5174-f5d1-474c-92c1-e1520aee1fe2 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:31.407708 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:31.430179 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e7b1b-1470-4cb9-a0da-205743aa0a0f None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:31.443380 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7aed4a-6c36-4a3e-b2f7-02cd4853e905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:31.444246 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7aed4a-6c36-4a3e-b2f7-02cd4853e905 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:31.444523 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7aed4a-6c36-4a3e-b2f7-02cd4853e905 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:31.444790 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7aed4a-6c36-4a3e-b2f7-02cd4853e905 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:31.456659 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7aed4a-6c36-4a3e-b2f7-02cd4853e905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:31.464707 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-ac7aed4a-6c36-4a3e-b2f7-02cd4853e905 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:31.464707 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:31.464707 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:31.464707 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:31.464707 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:31.464707 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:31.464707 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:31.464707 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:31.464707 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:31.464707 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:31.464707 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:31.464707 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:31.464707 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:31.464707 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:31.464707 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:31.464707 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:31.465575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:31.465575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:31.465575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:31.465575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:31.465575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:31.465575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:31.465575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:31.465575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:31.465575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:31.465575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:31.465575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:31.465575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:31.465575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:31.465575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:31.465575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:31.465575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:31.466360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:31.466360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:31.466360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:31.466360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:31.466360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:31.466360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:31.466360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:31.466360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:31.466360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:31.466360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:31.466360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:31.466360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:31.466360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 174/356] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:31.467138 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95350192-6f07-4518-9dc1-618e4e41b4fd None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:31.467390 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95350192-6f07-4518-9dc1-618e4e41b4fd None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:31.467644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95350192-6f07-4518-9dc1-618e4e41b4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:31.472960 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31262f-5198-4a27-9a76-137e6274d6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:31.474166 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31262f-5198-4a27-9a76-137e6274d6b0 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:31.474647 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31262f-5198-4a27-9a76-137e6274d6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:31.475108 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31262f-5198-4a27-9a76-137e6274d6b0 None admin] PATH_INFO: `/v3/groups/848f16a4feb14c9685410c9f306b2938` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:31.476484 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31262f-5198-4a27-9a76-137e6274d6b0 None admin] RBAC: Authorizing `identity:get_group(group_id=848f16a4feb14c9685410c9f306b2938)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:31.478102 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31262f-5198-4a27-9a76-137e6274d6b0 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:31.480012 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 183/357] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jul 2 20:37:31 2022] GET /identity/v3/groups/848f16a4feb14c9685410c9f306b2938 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:31.480953 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31262f-5198-4a27-9a76-137e6274d6b0 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:31.486514 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-95350192-6f07-4518-9dc1-618e4e41b4fd None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:31.489118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-95350192-6f07-4518-9dc1-618e4e41b4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:31.491479 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:31.566547 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 175/358] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:31.567543 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95350192-6f07-4518-9dc1-618e4e41b4fd None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:31.590699 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31262f-5198-4a27-9a76-137e6274d6b0 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:31.636127 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0425f9-5a91-4fbc-b0f8-c300f9ee93b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:31.637060 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0425f9-5a91-4fbc-b0f8-c300f9ee93b8 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:31.637343 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0425f9-5a91-4fbc-b0f8-c300f9ee93b8 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:31.637612 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0425f9-5a91-4fbc-b0f8-c300f9ee93b8 None admin] PATH_INFO: `/v3/users/5f8912082fec41d1bb5266595fd6b085` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:31.638856 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0425f9-5a91-4fbc-b0f8-c300f9ee93b8 None admin] RBAC: Authorizing `identity:get_user(user_id=5f8912082fec41d1bb5266595fd6b085)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:31.640495 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0425f9-5a91-4fbc-b0f8-c300f9ee93b8 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:31.642155 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 184/359] 10.222.0.57 () {56 vars in 1177 bytes} [Sat Jul 2 20:37:31 2022] GET /identity/v3/users/5f8912082fec41d1bb5266595fd6b085 => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:31.643987 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0425f9-5a91-4fbc-b0f8-c300f9ee93b8 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:31.665480 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:31.697467 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95350192-6f07-4518-9dc1-618e4e41b4fd None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:31.739475 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcc1357-bd70-46a4-b7db-c044ba6fad8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:31.740188 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc1357-bd70-46a4-b7db-c044ba6fad8d None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:31.740466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc1357-bd70-46a4-b7db-c044ba6fad8d None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:31.740735 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcc1357-bd70-46a4-b7db-c044ba6fad8d None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:31.741479 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc1357-bd70-46a4-b7db-c044ba6fad8d None admin] RBAC: Adding query filter params (name=member) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:31.741783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc1357-bd70-46a4-b7db-c044ba6fad8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:31.743749 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcc1357-bd70-46a4-b7db-c044ba6fad8d None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:31.751344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:31.756915 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 176/360] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:37:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:31.759023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb8a6f-aab7-45b8-9a19-cb108e918e45 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:31.759723 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb8a6f-aab7-45b8-9a19-cb108e918e45 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:31.760138 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb8a6f-aab7-45b8-9a19-cb108e918e45 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:31.761751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 177/361] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:31.762994 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb8a6f-aab7-45b8-9a19-cb108e918e45 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:31.772266 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0425f9-5a91-4fbc-b0f8-c300f9ee93b8 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:31.815241 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e90225-1fa2-418a-bef6-ae4503aa6b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:31.816306 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e90225-1fa2-418a-bef6-ae4503aa6b73 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:31.816790 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e90225-1fa2-418a-bef6-ae4503aa6b73 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:31.817062 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e90225-1fa2-418a-bef6-ae4503aa6b73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:31.817891 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e90225-1fa2-418a-bef6-ae4503aa6b73 None admin] RBAC: Adding query filter params (group.id=848f16a4feb14c9685410c9f306b2938, role.id=538580824ccd4e02823540ee3df31cdc, scope.project.id=17380892ecb2424e932154c8ad8864b7) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:31.818986 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e90225-1fa2-418a-bef6-ae4503aa6b73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:31.820176 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e90225-1fa2-418a-bef6-ae4503aa6b73 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:31.829905 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 185/362] 10.222.0.57 () {56 vars in 1376 bytes} [Sat Jul 2 20:37:31 2022] GET /identity/v3/role_assignments?group.id=848f16a4feb14c9685410c9f306b2938&scope.project.id=17380892ecb2424e932154c8ad8864b7&role.id=538580824ccd4e02823540ee3df31cdc => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:31.830787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e90225-1fa2-418a-bef6-ae4503aa6b73 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:31.908772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb8a6f-aab7-45b8-9a19-cb108e918e45 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:31.927174 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:31.949840 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e90225-1fa2-418a-bef6-ae4503aa6b73 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:31.966542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1499d-c387-4787-9d82-0b5eea4c0b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:31.967441 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1499d-c387-4787-9d82-0b5eea4c0b69 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:31.967723 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1499d-c387-4787-9d82-0b5eea4c0b69 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:31.967993 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1499d-c387-4787-9d82-0b5eea4c0b69 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:31.990484 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec7b1f-b497-4280-9f2b-519faa6a33c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:31.991229 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec7b1f-b497-4280-9f2b-519faa6a33c8 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:31.991508 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec7b1f-b497-4280-9f2b-519faa6a33c8 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:31.991781 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec7b1f-b497-4280-9f2b-519faa6a33c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:31.992626 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec7b1f-b497-4280-9f2b-519faa6a33c8 None admin] RBAC: Adding query filter params (role.id=5c2e2429808f41468c9b5a93d74645ba, user.id=5f8912082fec41d1bb5266595fd6b085, scope.system=all) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:31.992938 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec7b1f-b497-4280-9f2b-519faa6a33c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:31.994418 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec7b1f-b497-4280-9f2b-519faa6a33c8 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:31.999599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1499d-c387-4787-9d82-0b5eea4c0b69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:32.008683 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 186/363] 10.222.0.57 () {56 vars in 1308 bytes} [Sat Jul 2 20:37:31 2022] GET /identity/v3/role_assignments?user.id=5f8912082fec41d1bb5266595fd6b085&scope.system=all&role.id=5c2e2429808f41468c9b5a93d74645ba => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:32.008821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-e9c1499d-c387-4787-9d82-0b5eea4c0b69 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:37:32.008821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:32.008821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:32.008821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:32.008821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:32.008821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:32.008821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:32.008821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:32.008821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:32.008821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:32.008821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:32.008821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:32.008821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:32.008821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:32.008821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:32.008821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:32.009974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:32.009974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:32.009974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:32.009974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:32.009974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:32.009974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:32.009974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:32.009974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:32.009974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:32.009974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:32.009974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:32.009974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:32.009974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:32.009974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:32.009974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:32.009974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:32.010752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:32.010752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:32.010752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:32.010752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:32.010752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:32.010752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:32.010752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:32.010752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:32.010752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:32.010752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:32.010752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:37:32.010752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:32.010752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 178/364] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jul 2 20:37:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:32.018047 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec7b1f-b497-4280-9f2b-519faa6a33c8 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:32.019503 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d23400-0269-4094-b124-6752d8b5a44d None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:32.019801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d23400-0269-4094-b124-6752d8b5a44d None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:32.020078 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d23400-0269-4094-b124-6752d8b5a44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:32.066438 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-f4d23400-0269-4094-b124-6752d8b5a44d None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:32.068073 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-f4d23400-0269-4094-b124-6752d8b5a44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:32.147556 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:32.160505 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 179/365] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:32.161773 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d23400-0269-4094-b124-6752d8b5a44d None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:32.180051 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec7b1f-b497-4280-9f2b-519faa6a33c8 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:32.220767 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4d38f-7f2a-4257-9a2c-b577446c34b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:32.221439 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4d38f-7f2a-4257-9a2c-b577446c34b0 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:32.221728 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4d38f-7f2a-4257-9a2c-b577446c34b0 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:32.222005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4d38f-7f2a-4257-9a2c-b577446c34b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:32.235051 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:32.279585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d23400-0269-4094-b124-6752d8b5a44d None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:32.303851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4d38f-7f2a-4257-9a2c-b577446c34b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:32.305023 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4d38f-7f2a-4257-9a2c-b577446c34b0 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:32.318696 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf64bd-a515-46d2-ab28-ca507f0cb022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:32.319803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf64bd-a515-46d2-ab28-ca507f0cb022 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:32.320292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf64bd-a515-46d2-ab28-ca507f0cb022 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:32.320750 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf64bd-a515-46d2-ab28-ca507f0cb022 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:32.321695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf64bd-a515-46d2-ab28-ca507f0cb022 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:32.322300 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf64bd-a515-46d2-ab28-ca507f0cb022 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:32.324022 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf64bd-a515-46d2-ab28-ca507f0cb022 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:32.333477 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 180/366] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:37:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:32.334671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf64bd-a515-46d2-ab28-ca507f0cb022 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:32.393463 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:32.439850 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 187/367] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:37:32.440975 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4d38f-7f2a-4257-9a2c-b577446c34b0 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:32.454988 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf64bd-a515-46d2-ab28-ca507f0cb022 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:32.495910 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:32.505090 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb1f8e-e9c1-480b-a057-df20923724e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:32.506506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb1f8e-e9c1-480b-a057-df20923724e8 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:32.507126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb1f8e-e9c1-480b-a057-df20923724e8 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:32.507602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb1f8e-e9c1-480b-a057-df20923724e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:32.522042 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bb1f8e-e9c1-480b-a057-df20923724e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:32.530347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-c2bb1f8e-e9c1-480b-a057-df20923724e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:37:32.530347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:32.530347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:32.530347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:32.530347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:32.530347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:32.530347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:32.530347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:32.530347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:32.530347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:32.530347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:32.530347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:32.530347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:32.530347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:32.530347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:32.530347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:32.531247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:32.531247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:32.531247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:32.531247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:32.531247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:32.531247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:32.531247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:32.531247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:32.531247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:32.531247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:32.531247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:32.531247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:32.531247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:32.531247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:32.531247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:32.531247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:32.532769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:32.532769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:32.532769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:32.532769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:32.532769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:32.532769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:32.532769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:32.532769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:32.532769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:32.532769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:32.532769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:37:32.532769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:32.532769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 181/368] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jul 2 20:37:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:32.532769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb1f8e-e9c1-480b-a057-df20923724e8 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:32.586705 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4d38f-7f2a-4257-9a2c-b577446c34b0 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:32.623891 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c3ebf-b759-44fe-90ae-d2e560bece9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:32.624534 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c3ebf-b759-44fe-90ae-d2e560bece9e None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:32.624818 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c3ebf-b759-44fe-90ae-d2e560bece9e None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:32.625080 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c3ebf-b759-44fe-90ae-d2e560bece9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:32.679246 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bb1f8e-e9c1-480b-a057-df20923724e8 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:32.697632 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:32.712939 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c3ebf-b759-44fe-90ae-d2e560bece9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:32.714691 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c3ebf-b759-44fe-90ae-d2e560bece9e None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:32.734082 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c390a-9abd-4d7e-bfb8-f8eac8f9b1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:32.735162 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c390a-9abd-4d7e-bfb8-f8eac8f9b1b8 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:32.735460 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c390a-9abd-4d7e-bfb8-f8eac8f9b1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:32.735739 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c390a-9abd-4d7e-bfb8-f8eac8f9b1b8 None admin] PATH_INFO: `/v3/projects/407b7d25a7944d3295a63d668b0a6a62` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:32.737099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c390a-9abd-4d7e-bfb8-f8eac8f9b1b8 None admin] RBAC: Authorizing `identity:get_project(project_id=407b7d25a7944d3295a63d668b0a6a62)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:32.738619 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c390a-9abd-4d7e-bfb8-f8eac8f9b1b8 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:32.740445 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 182/369] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:32 2022] GET /identity/v3/projects/407b7d25a7944d3295a63d668b0a6a62 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:32.741343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c390a-9abd-4d7e-bfb8-f8eac8f9b1b8 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:32.767592 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:32.836225 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 188/370] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:37:32.836225 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c3ebf-b759-44fe-90ae-d2e560bece9e None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:32.875193 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c390a-9abd-4d7e-bfb8-f8eac8f9b1b8 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:32.925063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa566986-bc7b-43c0-bcf7-2a14bcc3e7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:32.926198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa566986-bc7b-43c0-bcf7-2a14bcc3e7e5 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:32.926576 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa566986-bc7b-43c0-bcf7-2a14bcc3e7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:32.927040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa566986-bc7b-43c0-bcf7-2a14bcc3e7e5 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:32.927901 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa566986-bc7b-43c0-bcf7-2a14bcc3e7e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:32.930112 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa566986-bc7b-43c0-bcf7-2a14bcc3e7e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:32.930112 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa566986-bc7b-43c0-bcf7-2a14bcc3e7e5 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:32.941263 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 183/371] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:32.942384 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa566986-bc7b-43c0-bcf7-2a14bcc3e7e5 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:32.963988 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c3ebf-b759-44fe-90ae-d2e560bece9e None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:32.992354 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:33.014350 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962e18b-6bbf-4d7c-aa33-e12ddc24805a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:33.015874 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962e18b-6bbf-4d7c-aa33-e12ddc24805a None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:33.016521 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962e18b-6bbf-4d7c-aa33-e12ddc24805a None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:33.016521 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962e18b-6bbf-4d7c-aa33-e12ddc24805a None admin] PATH_INFO: `/v3/groups/848f16a4feb14c9685410c9f306b2938` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:33.018703 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962e18b-6bbf-4d7c-aa33-e12ddc24805a None admin] RBAC: Authorizing `identity:get_group(group_id=848f16a4feb14c9685410c9f306b2938)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:33.020215 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962e18b-6bbf-4d7c-aa33-e12ddc24805a None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:33.022210 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 189/372] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jul 2 20:37:32 2022] GET /identity/v3/groups/848f16a4feb14c9685410c9f306b2938 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:33.030169 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962e18b-6bbf-4d7c-aa33-e12ddc24805a None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:33.039325 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:33.076785 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa566986-bc7b-43c0-bcf7-2a14bcc3e7e5 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:33.123943 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72f46d-ff2a-4546-a140-74659c435644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:33.124883 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72f46d-ff2a-4546-a140-74659c435644 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:33.125164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72f46d-ff2a-4546-a140-74659c435644 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:33.125662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c72f46d-ff2a-4546-a140-74659c435644 None admin] PATH_INFO: `/v3/projects/407b7d25a7944d3295a63d668b0a6a62` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:33.126855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72f46d-ff2a-4546-a140-74659c435644 None admin] RBAC: Authorizing `identity:get_project(project_id=407b7d25a7944d3295a63d668b0a6a62)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:33.128347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c72f46d-ff2a-4546-a140-74659c435644 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:33.130552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 184/373] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:32 2022] GET /identity/v3/projects/407b7d25a7944d3295a63d668b0a6a62 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:33.131414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72f46d-ff2a-4546-a140-74659c435644 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:33.159068 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962e18b-6bbf-4d7c-aa33-e12ddc24805a None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:33.207031 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9d9b6-89f4-4c99-8555-5fbac3cd2d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:33.208060 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9d9b6-89f4-4c99-8555-5fbac3cd2d0b None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:33.208552 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9d9b6-89f4-4c99-8555-5fbac3cd2d0b None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:33.210135 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9d9b6-89f4-4c99-8555-5fbac3cd2d0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:33.270045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c72f46d-ff2a-4546-a140-74659c435644 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:33.282178 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:33.297985 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9d9b6-89f4-4c99-8555-5fbac3cd2d0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:33.301361 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9d9b6-89f4-4c99-8555-5fbac3cd2d0b None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:33.309483 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768ea4c-fee2-40dd-8b2e-0c76d00f8902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:33.310469 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768ea4c-fee2-40dd-8b2e-0c76d00f8902 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:33.311081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768ea4c-fee2-40dd-8b2e-0c76d00f8902 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:33.311555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768ea4c-fee2-40dd-8b2e-0c76d00f8902 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:33.312602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768ea4c-fee2-40dd-8b2e-0c76d00f8902 None admin] RBAC: Adding query filter params (group.id=848f16a4feb14c9685410c9f306b2938, role.id=538580824ccd4e02823540ee3df31cdc, scope.project.id=407b7d25a7944d3295a63d668b0a6a62) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:33.313116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:33.314279 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768ea4c-fee2-40dd-8b2e-0c76d00f8902 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:33.316063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768ea4c-fee2-40dd-8b2e-0c76d00f8902 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:33.323830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 185/374] 10.222.0.57 () {56 vars in 1376 bytes} [Sat Jul 2 20:37:33 2022] GET /identity/v3/role_assignments?group.id=848f16a4feb14c9685410c9f306b2938&scope.project.id=407b7d25a7944d3295a63d668b0a6a62&role.id=538580824ccd4e02823540ee3df31cdc => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:33.324964 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768ea4c-fee2-40dd-8b2e-0c76d00f8902 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:33.451755 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 190/375] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:37:33.458278 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9d9b6-89f4-4c99-8555-5fbac3cd2d0b None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:33.479434 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768ea4c-fee2-40dd-8b2e-0c76d00f8902 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:33.522119 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfe6e9-6ee2-4276-9666-9fd10af5a57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:33.523438 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfe6e9-6ee2-4276-9666-9fd10af5a57e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:33.523886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfe6e9-6ee2-4276-9666-9fd10af5a57e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:33.524309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfe6e9-6ee2-4276-9666-9fd10af5a57e None admin] PATH_INFO: `/v3/groups/848f16a4feb14c9685410c9f306b2938` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:33.525734 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfe6e9-6ee2-4276-9666-9fd10af5a57e None admin] RBAC: Authorizing `identity:get_group(group_id=848f16a4feb14c9685410c9f306b2938)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:33.527598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfe6e9-6ee2-4276-9666-9fd10af5a57e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:33.529563 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 186/376] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jul 2 20:37:33 2022] GET /identity/v3/groups/848f16a4feb14c9685410c9f306b2938 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:33.549275 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfe6e9-6ee2-4276-9666-9fd10af5a57e None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:33.579608 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9d9b6-89f4-4c99-8555-5fbac3cd2d0b None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:33.591329 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:33.626937 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b98b8f-3198-4911-aee6-3757697af43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:33.626937 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b98b8f-3198-4911-aee6-3757697af43d None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:33.626937 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b98b8f-3198-4911-aee6-3757697af43d None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:33.626937 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b98b8f-3198-4911-aee6-3757697af43d None admin] PATH_INFO: `/v3/projects/48e1bdb53b064749bf22c6e982f8a7ab` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:33.627343 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b98b8f-3198-4911-aee6-3757697af43d None admin] RBAC: Authorizing `identity:get_project(project_id=48e1bdb53b064749bf22c6e982f8a7ab)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:33.627858 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b98b8f-3198-4911-aee6-3757697af43d None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:33.629896 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 191/377] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:33 2022] GET /identity/v3/projects/48e1bdb53b064749bf22c6e982f8a7ab => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:33.636664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:33.637690 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b98b8f-3198-4911-aee6-3757697af43d None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:33.747151 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfe6e9-6ee2-4276-9666-9fd10af5a57e None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:33.764146 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b98b8f-3198-4911-aee6-3757697af43d None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:33.796765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de9b251-0d0e-4c82-929f-db92fef5f3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:33.797525 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9b251-0d0e-4c82-929f-db92fef5f3de None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:33.797813 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9b251-0d0e-4c82-929f-db92fef5f3de None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:33.798113 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9b251-0d0e-4c82-929f-db92fef5f3de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:33.799571 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de9b251-0d0e-4c82-929f-db92fef5f3de None admin] RBAC: Adding query filter params (group.id=848f16a4feb14c9685410c9f306b2938, role.id=a03f493abb6846eebc4958aabe8b28ad, scope.project.id=407b7d25a7944d3295a63d668b0a6a62) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:33.799892 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de9b251-0d0e-4c82-929f-db92fef5f3de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:33.801504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de9b251-0d0e-4c82-929f-db92fef5f3de None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:33.807432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 187/378] 10.222.0.57 () {56 vars in 1376 bytes} [Sat Jul 2 20:37:33 2022] GET /identity/v3/role_assignments?group.id=848f16a4feb14c9685410c9f306b2938&scope.project.id=407b7d25a7944d3295a63d668b0a6a62&role.id=a03f493abb6846eebc4958aabe8b28ad => generated 260 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:33.811792 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33607783-1008-4566-a8e2-fb83d449b6bc None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:33.812084 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33607783-1008-4566-a8e2-fb83d449b6bc None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:33.812365 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33607783-1008-4566-a8e2-fb83d449b6bc None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:33.814174 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 188/379] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:33.817767 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97411b-dc8a-413f-9ee6-5f8136aa94ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:33.818797 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97411b-dc8a-413f-9ee6-5f8136aa94ae None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:33.819124 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97411b-dc8a-413f-9ee6-5f8136aa94ae None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:33.819412 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a97411b-dc8a-413f-9ee6-5f8136aa94ae None admin] PATH_INFO: `/v3/groups/73cac09c2eab4b5686f401d293e2dce4` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:33.821444 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000467c-13a9-44dd-8f8a-faaf8988ec63 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:33.821734 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000467c-13a9-44dd-8f8a-faaf8988ec63 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:33.822011 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000467c-13a9-44dd-8f8a-faaf8988ec63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:33.831287 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97411b-dc8a-413f-9ee6-5f8136aa94ae None admin] RBAC: Authorizing `identity:get_group(group_id=73cac09c2eab4b5686f401d293e2dce4)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:33.833219 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a97411b-dc8a-413f-9ee6-5f8136aa94ae None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:33.837052 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 192/380] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jul 2 20:37:33 2022] GET /identity/v3/groups/73cac09c2eab4b5686f401d293e2dce4 => generated 229 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:33.843016 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97411b-dc8a-413f-9ee6-5f8136aa94ae None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:33.843134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-7000467c-13a9-44dd-8f8a-faaf8988ec63 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:33.845098 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-7000467c-13a9-44dd-8f8a-faaf8988ec63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:33.892541 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:33.958936 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 189/381] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:33.967863 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a97411b-dc8a-413f-9ee6-5f8136aa94ae None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:34.019627 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f7a23-9f42-40d8-b025-0ef0d34a2cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:34.021149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f7a23-9f42-40d8-b025-0ef0d34a2cff None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:34.021643 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f7a23-9f42-40d8-b025-0ef0d34a2cff None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:34.022116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f7a23-9f42-40d8-b025-0ef0d34a2cff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:34.023185 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f7a23-9f42-40d8-b025-0ef0d34a2cff None admin] RBAC: Adding query filter params (group.id=73cac09c2eab4b5686f401d293e2dce4, role.id=353a58700c5640988ce2c9012e847cf8, scope.project.id=48e1bdb53b064749bf22c6e982f8a7ab) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:34.023695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f7a23-9f42-40d8-b025-0ef0d34a2cff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:34.025351 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f7a23-9f42-40d8-b025-0ef0d34a2cff None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:34.036665 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 193/382] 10.222.0.57 () {56 vars in 1376 bytes} [Sat Jul 2 20:37:33 2022] GET /identity/v3/role_assignments?group.id=73cac09c2eab4b5686f401d293e2dce4&scope.project.id=48e1bdb53b064749bf22c6e982f8a7ab&role.id=353a58700c5640988ce2c9012e847cf8 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:34.041788 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000467c-13a9-44dd-8f8a-faaf8988ec63 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:34.087355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:34.173269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000467c-13a9-44dd-8f8a-faaf8988ec63 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:34.215967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d50e3-fdad-4fcb-bb60-41bb445864e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:34.216801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d50e3-fdad-4fcb-bb60-41bb445864e0 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:34.217087 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d50e3-fdad-4fcb-bb60-41bb445864e0 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:34.217363 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d50e3-fdad-4fcb-bb60-41bb445864e0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:34.232508 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d50e3-fdad-4fcb-bb60-41bb445864e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:34.241506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-c77d50e3-fdad-4fcb-bb60-41bb445864e0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:37:34.241506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:34.241506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:34.241506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:34.241506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:34.241506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:34.241506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:34.241506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:34.241506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:34.241506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:34.241506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:34.241506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:34.241506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:34.241506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:34.241506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:34.241506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:34.242404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:34.242404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:34.242404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:34.242404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:34.242404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:34.242404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:34.242404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:34.242404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:34.242404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:34.242404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:34.242404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:34.242404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:34.242404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:34.242404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:34.242404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:34.242404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:34.243221 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:34.243221 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:34.243221 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:34.243221 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:34.243221 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:34.243221 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:34.243221 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:34.243221 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:34.243221 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:34.243221 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:34.243221 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:37:34.243221 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:34.247161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 190/383] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jul 2 20:37:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:34.252076 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f7a23-9f42-40d8-b025-0ef0d34a2cff None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:34.379628 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f7a23-9f42-40d8-b025-0ef0d34a2cff None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:34.384184 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:34.420016 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b26ac-f54d-4746-bbcd-8cf4a82a340c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:34.421062 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b26ac-f54d-4746-bbcd-8cf4a82a340c None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:34.421537 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b26ac-f54d-4746-bbcd-8cf4a82a340c None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:34.422001 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b26ac-f54d-4746-bbcd-8cf4a82a340c None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:34.423211 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b26ac-f54d-4746-bbcd-8cf4a82a340c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:34.423746 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b26ac-f54d-4746-bbcd-8cf4a82a340c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:34.425350 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b26ac-f54d-4746-bbcd-8cf4a82a340c None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:34.439296 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 194/384] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:37:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:34.441689 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d50e3-fdad-4fcb-bb60-41bb445864e0 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:34.560429 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:34.570303 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d50e3-fdad-4fcb-bb60-41bb445864e0 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:34.614357 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ca598f-1b94-4a94-92e0-491e876a6264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:34.615262 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca598f-1b94-4a94-92e0-491e876a6264 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:34.615547 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca598f-1b94-4a94-92e0-491e876a6264 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:34.615821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ca598f-1b94-4a94-92e0-491e876a6264 None admin] PATH_INFO: `/v3/groups/848f16a4feb14c9685410c9f306b2938` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:34.617112 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca598f-1b94-4a94-92e0-491e876a6264 None admin] RBAC: Authorizing `identity:get_group(group_id=848f16a4feb14c9685410c9f306b2938)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:34.618590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ca598f-1b94-4a94-92e0-491e876a6264 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:34.620569 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 191/385] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jul 2 20:37:34 2022] GET /identity/v3/groups/848f16a4feb14c9685410c9f306b2938 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:34.626229 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b26ac-f54d-4746-bbcd-8cf4a82a340c None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:34.770622 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b26ac-f54d-4746-bbcd-8cf4a82a340c None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:34.777932 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d9e5a-9dc6-427a-9a88-5792435f38a4 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:34.778223 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d9e5a-9dc6-427a-9a88-5792435f38a4 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:34.778511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d9e5a-9dc6-427a-9a88-5792435f38a4 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:34.780099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 192/386] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:34.790686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee34e3b-25b7-4a44-977c-f0b0e17eecbd None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:34.791027 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee34e3b-25b7-4a44-977c-f0b0e17eecbd None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:34.791312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee34e3b-25b7-4a44-977c-f0b0e17eecbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:34.810587 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48552c-ed06-4f98-9009-351e068da19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:34.811733 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48552c-ed06-4f98-9009-351e068da19f None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:34.812156 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48552c-ed06-4f98-9009-351e068da19f None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:34.812560 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48552c-ed06-4f98-9009-351e068da19f None admin] PATH_INFO: `/v3/projects/17380892ecb2424e932154c8ad8864b7` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:34.814136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48552c-ed06-4f98-9009-351e068da19f None admin] RBAC: Authorizing `identity:get_project(project_id=17380892ecb2424e932154c8ad8864b7)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:34.815783 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48552c-ed06-4f98-9009-351e068da19f None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:34.817927 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 195/387] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:34 2022] GET /identity/v3/projects/17380892ecb2424e932154c8ad8864b7 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:34.823465 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48552c-ed06-4f98-9009-351e068da19f None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:34.823661 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-9ee34e3b-25b7-4a44-977c-f0b0e17eecbd None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:34.824926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-9ee34e3b-25b7-4a44-977c-f0b0e17eecbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:34.867516 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:34.953699 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 193/388] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:37:34.975962 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48552c-ed06-4f98-9009-351e068da19f None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:34.985192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee34e3b-25b7-4a44-977c-f0b0e17eecbd None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:35.053110 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9c011-ebaf-49db-b298-72b1a69c167d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:35.054589 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9c011-ebaf-49db-b298-72b1a69c167d None admin] REQUEST_METHOD: `PUT` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:35.055131 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9c011-ebaf-49db-b298-72b1a69c167d None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:35.055545 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9c011-ebaf-49db-b298-72b1a69c167d None admin] PATH_INFO: `/v3/projects/17380892ecb2424e932154c8ad8864b7/groups/848f16a4feb14c9685410c9f306b2938/roles/a03f493abb6846eebc4958aabe8b28ad` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:35.059380 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9c011-ebaf-49db-b298-72b1a69c167d None admin] RBAC: Authorizing `identity:create_grant(project_id=17380892ecb2424e932154c8ad8864b7, group_id=848f16a4feb14c9685410c9f306b2938, role_id=a03f493abb6846eebc4958aabe8b28ad)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:35.061090 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9c011-ebaf-49db-b298-72b1a69c167d None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:35.085468 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 196/389] 10.222.0.57 () {58 vars in 1442 bytes} [Sat Jul 2 20:37:34 2022] PUT /identity/v3/projects/17380892ecb2424e932154c8ad8864b7/groups/848f16a4feb14c9685410c9f306b2938/roles/a03f493abb6846eebc4958aabe8b28ad => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 20:37:35.109346 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:35.117700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee34e3b-25b7-4a44-977c-f0b0e17eecbd None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:35.157878 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a3a09-e877-4a9b-bad9-1dd1d73a03dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:35.158716 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a3a09-e877-4a9b-bad9-1dd1d73a03dd None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:35.159020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a3a09-e877-4a9b-bad9-1dd1d73a03dd None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:35.159295 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a3a09-e877-4a9b-bad9-1dd1d73a03dd None admin] PATH_INFO: `/v3/roles/member` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:35.170784 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a3a09-e877-4a9b-bad9-1dd1d73a03dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:35.178954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-596a3a09-e877-4a9b-bad9-1dd1d73a03dd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:35.178954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:35.178954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:35.178954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:35.178954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:35.178954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:35.178954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:35.178954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:35.178954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:35.178954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:35.178954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:35.178954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:35.178954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:35.178954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:35.178954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:35.178954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:35.179873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:35.179873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:35.179873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:35.179873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:35.179873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:35.179873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:35.179873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:35.179873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:35.179873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:35.179873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:35.179873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:35.179873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:35.179873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:35.179873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:35.179873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:35.179873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:35.180721 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:35.180721 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:35.180721 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:35.180721 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:35.180721 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:35.180721 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:35.180721 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:35.180721 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:35.180721 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:35.180721 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:35.180721 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:35.180721 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:35.181306 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 194/390] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:37:35.186579 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9c011-ebaf-49db-b298-72b1a69c167d None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:35.311637 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:35.322377 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9c011-ebaf-49db-b298-72b1a69c167d None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:35.363161 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6ca5f-a5d7-476c-ab84-1fe887ae1917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:35.364133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6ca5f-a5d7-476c-ab84-1fe887ae1917 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:35.364551 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6ca5f-a5d7-476c-ab84-1fe887ae1917 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:35.365000 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db6ca5f-a5d7-476c-ab84-1fe887ae1917 None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:35.365954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6ca5f-a5d7-476c-ab84-1fe887ae1917 None admin] RBAC: Adding query filter params (name=member) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:35.366409 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6ca5f-a5d7-476c-ab84-1fe887ae1917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:35.368015 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db6ca5f-a5d7-476c-ab84-1fe887ae1917 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:35.378090 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 197/391] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:37:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:35.383886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a3a09-e877-4a9b-bad9-1dd1d73a03dd None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:35.530328 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a3a09-e877-4a9b-bad9-1dd1d73a03dd None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:35.567534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c80db-bafa-421f-b5c3-9c9ee90fed3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:35.568325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c80db-bafa-421f-b5c3-9c9ee90fed3c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:35.568681 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c80db-bafa-421f-b5c3-9c9ee90fed3c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:35.568876 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989c80db-bafa-421f-b5c3-9c9ee90fed3c None admin] PATH_INFO: `/v3/groups/848f16a4feb14c9685410c9f306b2938` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:35.570064 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c80db-bafa-421f-b5c3-9c9ee90fed3c None admin] RBAC: Authorizing `identity:get_group(group_id=848f16a4feb14c9685410c9f306b2938)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:35.571694 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989c80db-bafa-421f-b5c3-9c9ee90fed3c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:35.573327 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 195/392] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jul 2 20:37:35 2022] GET /identity/v3/groups/848f16a4feb14c9685410c9f306b2938 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:35.579730 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6ca5f-a5d7-476c-ab84-1fe887ae1917 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:35.710504 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db6ca5f-a5d7-476c-ab84-1fe887ae1917 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:35.748033 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5173f8-adda-452f-98c5-45a8372fe772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:35.748912 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5173f8-adda-452f-98c5-45a8372fe772 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:35.749186 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5173f8-adda-452f-98c5-45a8372fe772 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:35.749453 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5173f8-adda-452f-98c5-45a8372fe772 None admin] PATH_INFO: `/v3/projects/17380892ecb2424e932154c8ad8864b7` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:35.750741 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5173f8-adda-452f-98c5-45a8372fe772 None admin] RBAC: Authorizing `identity:get_project(project_id=17380892ecb2424e932154c8ad8864b7)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:35.752518 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5173f8-adda-452f-98c5-45a8372fe772 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:35.754545 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 198/393] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:35 2022] GET /identity/v3/projects/17380892ecb2424e932154c8ad8864b7 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:35.760357 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c80db-bafa-421f-b5c3-9c9ee90fed3c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:35.795924 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:35.901080 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989c80db-bafa-421f-b5c3-9c9ee90fed3c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:35.944444 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf55e16-49bf-4044-8fc4-ec1e2d9c1086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:35.945349 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf55e16-49bf-4044-8fc4-ec1e2d9c1086 None admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:35.945632 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf55e16-49bf-4044-8fc4-ec1e2d9c1086 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:35.945906 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf55e16-49bf-4044-8fc4-ec1e2d9c1086 None admin] PATH_INFO: `/v3/projects/17380892ecb2424e932154c8ad8864b7/groups/848f16a4feb14c9685410c9f306b2938/roles/538580824ccd4e02823540ee3df31cdc` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:35.947934 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf55e16-49bf-4044-8fc4-ec1e2d9c1086 None admin] RBAC: Authorizing `identity:create_grant(project_id=17380892ecb2424e932154c8ad8864b7, group_id=848f16a4feb14c9685410c9f306b2938, role_id=538580824ccd4e02823540ee3df31cdc)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:35.949384 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf55e16-49bf-4044-8fc4-ec1e2d9c1086 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:35.976994 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 196/394] 10.222.0.57 () {58 vars in 1442 bytes} [Sat Jul 2 20:37:35 2022] PUT /identity/v3/projects/17380892ecb2424e932154c8ad8864b7/groups/848f16a4feb14c9685410c9f306b2938/roles/538580824ccd4e02823540ee3df31cdc => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:37:36.592674 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791ba2c-6fe9-4388-81aa-518d83f62671 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:36.593195 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791ba2c-6fe9-4388-81aa-518d83f62671 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:36.593195 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f791ba2c-6fe9-4388-81aa-518d83f62671 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:36.594951 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 199/395] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:36.600818 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0efe97-7a95-4fb9-907f-02c6fce47d9a None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:36.601700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0efe97-7a95-4fb9-907f-02c6fce47d9a None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:36.602177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0efe97-7a95-4fb9-907f-02c6fce47d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:36.624831 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-bf0efe97-7a95-4fb9-907f-02c6fce47d9a None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:36.626521 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-bf0efe97-7a95-4fb9-907f-02c6fce47d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:36.706389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 197/396] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:37:36.733602 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791ba2c-6fe9-4388-81aa-518d83f62671 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:36.772774 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:36.864903 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f791ba2c-6fe9-4388-81aa-518d83f62671 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:36.899220 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c1529-4289-4701-97fb-8c3695adf743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:36.900049 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c1529-4289-4701-97fb-8c3695adf743 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:36.900323 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c1529-4289-4701-97fb-8c3695adf743 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:36.900598 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c1529-4289-4701-97fb-8c3695adf743 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:36.911534 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c1529-4289-4701-97fb-8c3695adf743 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:36.919772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-522c1529-4289-4701-97fb-8c3695adf743 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:37:36.919772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:36.919772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:36.919772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:36.919772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:36.919772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:36.919772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:36.919772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:36.919772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:36.919772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:36.919772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:36.919772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:36.919772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:36.919772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:36.919772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:36.919772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:36.920649 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:36.920649 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:36.920649 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:36.920649 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:36.920649 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:36.920649 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:36.920649 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:36.920649 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:36.920649 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:36.920649 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:36.920649 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:36.920649 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:36.920649 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:36.920649 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:36.920649 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:36.920649 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:36.921436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:36.921436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:36.921436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:36.921436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:36.921436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:36.921436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:36.921436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:36.921436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:36.921436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:36.921436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:36.921436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:37:36.921436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:36.921436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 200/397] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jul 2 20:37:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:36.927389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0efe97-7a95-4fb9-907f-02c6fce47d9a None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:36.933350 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe662d-b52f-4c6f-9c96-35ba52f50546 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:36.933881 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe662d-b52f-4c6f-9c96-35ba52f50546 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:36.934369 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe662d-b52f-4c6f-9c96-35ba52f50546 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:36.936217 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 201/398] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:37:36.944525 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf39f2-fb6b-4572-bd2c-38e68ffefc31 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:36.945066 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf39f2-fb6b-4572-bd2c-38e68ffefc31 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:36.945530 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf39f2-fb6b-4572-bd2c-38e68ffefc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:36.947101 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:36.964004 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-7faf39f2-fb6b-4572-bd2c-38e68ffefc31 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:36.965521 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-7faf39f2-fb6b-4572-bd2c-38e68ffefc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:37.037015 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 202/399] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:37.046924 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8d5d4-28bc-4c4c-83c9-e99802940ee5 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:37.047723 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8d5d4-28bc-4c4c-83c9-e99802940ee5 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:37.048411 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8d5d4-28bc-4c4c-83c9-e99802940ee5 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:37.050064 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 203/400] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:37 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:37.056344 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75137200-98a8-4284-855e-c6df3ada41af None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:37.056850 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75137200-98a8-4284-855e-c6df3ada41af None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:37.057309 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75137200-98a8-4284-855e-c6df3ada41af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:37.061788 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0efe97-7a95-4fb9-907f-02c6fce47d9a None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:37.085558 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-75137200-98a8-4284-855e-c6df3ada41af None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:37.087240 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-75137200-98a8-4284-855e-c6df3ada41af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:37.097561 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079f3e6-5646-493f-b539-bd072b0ead6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:37.098245 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079f3e6-5646-493f-b539-bd072b0ead6e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:37.098474 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:37.098572 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079f3e6-5646-493f-b539-bd072b0ead6e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:37.098784 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079f3e6-5646-493f-b539-bd072b0ead6e None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:37.099582 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079f3e6-5646-493f-b539-bd072b0ead6e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:37.100229 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079f3e6-5646-493f-b539-bd072b0ead6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:37.101636 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079f3e6-5646-493f-b539-bd072b0ead6e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:37.110474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 198/401] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:37:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:37.111439 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079f3e6-5646-493f-b539-bd072b0ead6e None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:37.161709 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 204/402] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:37:37.162845 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75137200-98a8-4284-855e-c6df3ada41af None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:37.204936 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:37.235595 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079f3e6-5646-493f-b539-bd072b0ead6e None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:37.270850 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869cc2a-51ff-4898-a0e5-fa9298c47741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:37.271874 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869cc2a-51ff-4898-a0e5-fa9298c47741 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:37.272255 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869cc2a-51ff-4898-a0e5-fa9298c47741 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:37.272709 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869cc2a-51ff-4898-a0e5-fa9298c47741 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:37.274948 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75137200-98a8-4284-855e-c6df3ada41af None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:37.285277 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869cc2a-51ff-4898-a0e5-fa9298c47741 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:37.293587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-4869cc2a-51ff-4898-a0e5-fa9298c47741 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:37.293587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:37.293587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:37.293587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:37.293587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:37.293587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:37.293587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:37.293587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:37.293587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:37.293587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:37.293587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:37.293587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:37.293587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:37.293587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:37.293587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:37.293587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:37.294560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:37.294560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:37.294560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:37.294560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:37.294560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:37.294560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:37.294560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:37.294560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:37.294560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:37.294560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:37.294560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:37.294560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:37.294560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:37.294560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:37.294560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:37.294560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:37.295455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:37.295455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:37.295455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:37.295455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:37.295455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:37.295455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:37.295455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:37.295455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:37.295455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:37.295455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:37.295455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:37.295455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:37.296048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 199/403] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:37.296585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869cc2a-51ff-4898-a0e5-fa9298c47741 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:37.316843 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6910b98-7db0-487d-b542-8df3089910dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:37.317999 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6910b98-7db0-487d-b542-8df3089910dd None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:37.318448 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6910b98-7db0-487d-b542-8df3089910dd None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:37.318925 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6910b98-7db0-487d-b542-8df3089910dd None admin] PATH_INFO: `/v3/groups/848f16a4feb14c9685410c9f306b2938` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:37.320354 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6910b98-7db0-487d-b542-8df3089910dd None admin] RBAC: Authorizing `identity:get_group(group_id=848f16a4feb14c9685410c9f306b2938)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:37.321975 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6910b98-7db0-487d-b542-8df3089910dd None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:37.323822 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 205/404] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jul 2 20:37:37 2022] GET /identity/v3/groups/848f16a4feb14c9685410c9f306b2938 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:37.324736 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6910b98-7db0-487d-b542-8df3089910dd None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:37.344122 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:37.401038 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869cc2a-51ff-4898-a0e5-fa9298c47741 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:37.435956 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3a7b8-598f-421c-9c01-5f2521caedad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:37.436754 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6910b98-7db0-487d-b542-8df3089910dd None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:37.436864 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3a7b8-598f-421c-9c01-5f2521caedad None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:37.437129 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3a7b8-598f-421c-9c01-5f2521caedad None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:37.437478 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3a7b8-598f-421c-9c01-5f2521caedad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:37.440425 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:37.449136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3a7b8-598f-421c-9c01-5f2521caedad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:37.457466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-c3a3a7b8-598f-421c-9c01-5f2521caedad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:37:37.457466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:37.457466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:37.457466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:37.457466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:37.457466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:37.457466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:37.457466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:37.457466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:37.457466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:37.457466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:37.457466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:37.457466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:37.457466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:37.457466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:37.457466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:37.458566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:37.458566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:37.458566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:37.458566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:37.458566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:37.458566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:37.458566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:37.458566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:37.458566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:37.458566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:37.458566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:37.458566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:37.458566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:37.458566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:37.458566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:37.458566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:37.459512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:37.459512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:37.459512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:37.459512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:37.459512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:37.459512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:37.459512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:37.459512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:37.459512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:37.459512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:37.459512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:37:37.459512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:37.460377 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 200/405] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jul 2 20:37:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:37.461275 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3a7b8-598f-421c-9c01-5f2521caedad None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:37.479010 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f44bb4-e637-4916-bf8e-07de4ccf2199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:37.479947 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f44bb4-e637-4916-bf8e-07de4ccf2199 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:37.480462 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f44bb4-e637-4916-bf8e-07de4ccf2199 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:37.480893 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f44bb4-e637-4916-bf8e-07de4ccf2199 None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:37.481869 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f44bb4-e637-4916-bf8e-07de4ccf2199 None admin] RBAC: Adding query filter params (name=member) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:37.482306 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f44bb4-e637-4916-bf8e-07de4ccf2199 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:37.483889 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f44bb4-e637-4916-bf8e-07de4ccf2199 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:37.498232 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 206/406] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:37:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:37.499602 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f44bb4-e637-4916-bf8e-07de4ccf2199 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:37.563951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3a7b8-598f-421c-9c01-5f2521caedad None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:37.581996 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:37.599492 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344fdb53-7292-4b55-a623-7cb1f4757814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:37.600660 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fdb53-7292-4b55-a623-7cb1f4757814 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:37.601045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fdb53-7292-4b55-a623-7cb1f4757814 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:37.601606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344fdb53-7292-4b55-a623-7cb1f4757814 None admin] PATH_INFO: `/v3/projects/407b7d25a7944d3295a63d668b0a6a62` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:37.603322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344fdb53-7292-4b55-a623-7cb1f4757814 None admin] RBAC: Authorizing `identity:get_project(project_id=407b7d25a7944d3295a63d668b0a6a62)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:37.605343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344fdb53-7292-4b55-a623-7cb1f4757814 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:37.611068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 201/407] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:37 2022] GET /identity/v3/projects/407b7d25a7944d3295a63d668b0a6a62 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:37.611068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344fdb53-7292-4b55-a623-7cb1f4757814 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:37.616548 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f44bb4-e637-4916-bf8e-07de4ccf2199 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:37.660391 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe4582-78e9-4f2c-9f4c-e7cd2a199d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:37.661321 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe4582-78e9-4f2c-9f4c-e7cd2a199d1d None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:37.661601 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe4582-78e9-4f2c-9f4c-e7cd2a199d1d None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:37.661872 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fe4582-78e9-4f2c-9f4c-e7cd2a199d1d None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:37.662726 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe4582-78e9-4f2c-9f4c-e7cd2a199d1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:37.663084 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe4582-78e9-4f2c-9f4c-e7cd2a199d1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:37.665402 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fe4582-78e9-4f2c-9f4c-e7cd2a199d1d None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:37.677823 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 207/408] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:37.678769 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe4582-78e9-4f2c-9f4c-e7cd2a199d1d None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:37.682352 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:37.734471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344fdb53-7292-4b55-a623-7cb1f4757814 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:37.786298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ffc8e-3053-4296-9d00-c3efb124028c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:37.787207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ffc8e-3053-4296-9d00-c3efb124028c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:37.787488 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ffc8e-3053-4296-9d00-c3efb124028c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:37.787760 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ffc8e-3053-4296-9d00-c3efb124028c None admin] PATH_INFO: `/v3/groups/848f16a4feb14c9685410c9f306b2938` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:37.789580 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ffc8e-3053-4296-9d00-c3efb124028c None admin] RBAC: Authorizing `identity:get_group(group_id=848f16a4feb14c9685410c9f306b2938)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:37.791319 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ffc8e-3053-4296-9d00-c3efb124028c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:37.792457 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fe4582-78e9-4f2c-9f4c-e7cd2a199d1d None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:37.793111 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 202/409] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jul 2 20:37:37 2022] GET /identity/v3/groups/848f16a4feb14c9685410c9f306b2938 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:37.793698 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ffc8e-3053-4296-9d00-c3efb124028c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:37.833503 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6829d3f-14d8-42ed-a636-411b8f476e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:37.834764 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6829d3f-14d8-42ed-a636-411b8f476e59 None admin] REQUEST_METHOD: `PUT` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:37.835276 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6829d3f-14d8-42ed-a636-411b8f476e59 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:37.835766 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6829d3f-14d8-42ed-a636-411b8f476e59 None admin] PATH_INFO: `/v3/projects/407b7d25a7944d3295a63d668b0a6a62/groups/848f16a4feb14c9685410c9f306b2938/roles/a03f493abb6846eebc4958aabe8b28ad` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:37.838270 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6829d3f-14d8-42ed-a636-411b8f476e59 None admin] RBAC: Authorizing `identity:create_grant(project_id=407b7d25a7944d3295a63d668b0a6a62, group_id=848f16a4feb14c9685410c9f306b2938, role_id=a03f493abb6846eebc4958aabe8b28ad)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:37.840076 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6829d3f-14d8-42ed-a636-411b8f476e59 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:37.844176 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:37.860269 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 208/410] 10.222.0.57 () {58 vars in 1442 bytes} [Sat Jul 2 20:37:37 2022] PUT /identity/v3/projects/407b7d25a7944d3295a63d668b0a6a62/groups/848f16a4feb14c9685410c9f306b2938/roles/a03f493abb6846eebc4958aabe8b28ad => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:37:37.868556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6829d3f-14d8-42ed-a636-411b8f476e59 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:37.931589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ffc8e-3053-4296-9d00-c3efb124028c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:37.994050 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6829d3f-14d8-42ed-a636-411b8f476e59 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:38.004966 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:38.029049 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b08fc-50bd-4044-8ad9-a83ba0e30ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:38.029932 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b08fc-50bd-4044-8ad9-a83ba0e30ba4 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:38.030211 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b08fc-50bd-4044-8ad9-a83ba0e30ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:38.030481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552b08fc-50bd-4044-8ad9-a83ba0e30ba4 None admin] PATH_INFO: `/v3/groups/73cac09c2eab4b5686f401d293e2dce4` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:38.031837 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b08fc-50bd-4044-8ad9-a83ba0e30ba4 None admin] RBAC: Authorizing `identity:get_group(group_id=73cac09c2eab4b5686f401d293e2dce4)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:38.033643 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552b08fc-50bd-4044-8ad9-a83ba0e30ba4 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:38.034694 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8c73a-6811-400d-87ea-138210b273d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:38.035767 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 203/411] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jul 2 20:37:37 2022] GET /identity/v3/groups/73cac09c2eab4b5686f401d293e2dce4 => generated 229 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:38.035877 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8c73a-6811-400d-87ea-138210b273d1 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:38.036225 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8c73a-6811-400d-87ea-138210b273d1 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:38.036596 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8c73a-6811-400d-87ea-138210b273d1 None admin] PATH_INFO: `/v3/projects/407b7d25a7944d3295a63d668b0a6a62` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:38.043996 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8c73a-6811-400d-87ea-138210b273d1 None admin] RBAC: Authorizing `identity:get_project(project_id=407b7d25a7944d3295a63d668b0a6a62)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:38.045504 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8c73a-6811-400d-87ea-138210b273d1 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:38.048256 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b08fc-50bd-4044-8ad9-a83ba0e30ba4 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:38.053149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 209/412] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:37 2022] GET /identity/v3/projects/407b7d25a7944d3295a63d668b0a6a62 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:38.058933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8c73a-6811-400d-87ea-138210b273d1 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:38.166565 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:38.211969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552b08fc-50bd-4044-8ad9-a83ba0e30ba4 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:38.215827 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8c73a-6811-400d-87ea-138210b273d1 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:38.255770 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e49d72-6896-417d-9f3c-43c6d2fb41b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:38.256789 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba41c17-a5eb-4480-b8cf-fad9a48090f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:38.257219 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e49d72-6896-417d-9f3c-43c6d2fb41b9 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:38.257687 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e49d72-6896-417d-9f3c-43c6d2fb41b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:38.258142 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e49d72-6896-417d-9f3c-43c6d2fb41b9 None admin] PATH_INFO: `/v3/projects/48e1bdb53b064749bf22c6e982f8a7ab` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:38.260059 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba41c17-a5eb-4480-b8cf-fad9a48090f1 None admin] REQUEST_METHOD: `PUT` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:38.260170 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba41c17-a5eb-4480-b8cf-fad9a48090f1 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:38.260386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba41c17-a5eb-4480-b8cf-fad9a48090f1 None admin] PATH_INFO: `/v3/projects/407b7d25a7944d3295a63d668b0a6a62/groups/848f16a4feb14c9685410c9f306b2938/roles/538580824ccd4e02823540ee3df31cdc` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:38.260991 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e49d72-6896-417d-9f3c-43c6d2fb41b9 None admin] RBAC: Authorizing `identity:get_project(project_id=48e1bdb53b064749bf22c6e982f8a7ab)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:38.262395 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba41c17-a5eb-4480-b8cf-fad9a48090f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=407b7d25a7944d3295a63d668b0a6a62, group_id=848f16a4feb14c9685410c9f306b2938, role_id=538580824ccd4e02823540ee3df31cdc)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:38.262836 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e49d72-6896-417d-9f3c-43c6d2fb41b9 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:38.263865 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba41c17-a5eb-4480-b8cf-fad9a48090f1 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:38.265285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 204/413] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:38 2022] GET /identity/v3/projects/48e1bdb53b064749bf22c6e982f8a7ab => generated 344 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:38.272652 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e49d72-6896-417d-9f3c-43c6d2fb41b9 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:38.286361 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 210/414] 10.222.0.57 () {58 vars in 1442 bytes} [Sat Jul 2 20:37:38 2022] PUT /identity/v3/projects/407b7d25a7944d3295a63d668b0a6a62/groups/848f16a4feb14c9685410c9f306b2938/roles/538580824ccd4e02823540ee3df31cdc => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:37:38.353358 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:38.393139 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e49d72-6896-417d-9f3c-43c6d2fb41b9 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:38.430798 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff043c03-b4b0-4bcd-9d3d-f03bfffa20d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:38.431972 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff043c03-b4b0-4bcd-9d3d-f03bfffa20d9 None admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:38.432390 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff043c03-b4b0-4bcd-9d3d-f03bfffa20d9 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:38.432799 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff043c03-b4b0-4bcd-9d3d-f03bfffa20d9 None admin] PATH_INFO: `/v3/projects/48e1bdb53b064749bf22c6e982f8a7ab/groups/73cac09c2eab4b5686f401d293e2dce4/roles/353a58700c5640988ce2c9012e847cf8` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:38.435044 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff043c03-b4b0-4bcd-9d3d-f03bfffa20d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=48e1bdb53b064749bf22c6e982f8a7ab, group_id=73cac09c2eab4b5686f401d293e2dce4, role_id=353a58700c5640988ce2c9012e847cf8)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:38.436689 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff043c03-b4b0-4bcd-9d3d-f03bfffa20d9 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:38.463093 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 205/415] 10.222.0.57 () {58 vars in 1442 bytes} [Sat Jul 2 20:37:38 2022] PUT /identity/v3/projects/48e1bdb53b064749bf22c6e982f8a7ab/groups/73cac09c2eab4b5686f401d293e2dce4/roles/353a58700c5640988ce2c9012e847cf8 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:37:38.556932 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09b805-3b37-4570-a321-a66c5d1f25b3 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:38.557238 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09b805-3b37-4570-a321-a66c5d1f25b3 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:38.557498 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef09b805-3b37-4570-a321-a66c5d1f25b3 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:38.559221 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 211/416] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:38.564740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dc220-8d59-4adb-96d8-7e81d7835a7e None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:38.565344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dc220-8d59-4adb-96d8-7e81d7835a7e None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:38.565820 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845dc220-8d59-4adb-96d8-7e81d7835a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:38.588955 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-845dc220-8d59-4adb-96d8-7e81d7835a7e None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:38.590194 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-845dc220-8d59-4adb-96d8-7e81d7835a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:38.678663 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 206/417] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:37:38.711107 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09b805-3b37-4570-a321-a66c5d1f25b3 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:38.840425 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef09b805-3b37-4570-a321-a66c5d1f25b3 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:38.874469 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:38.889521 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49902493-1039-4835-84e5-4a3b39cd97e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:38.890430 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49902493-1039-4835-84e5-4a3b39cd97e4 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:38.891200 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49902493-1039-4835-84e5-4a3b39cd97e4 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:38.891479 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49902493-1039-4835-84e5-4a3b39cd97e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:38.910734 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49902493-1039-4835-84e5-4a3b39cd97e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:38.918891 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-49902493-1039-4835-84e5-4a3b39cd97e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:37:38.918891 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:38.918891 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:38.918891 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:38.918891 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:38.918891 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:38.918891 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:38.918891 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:38.918891 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:38.918891 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:38.918891 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:38.918891 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:38.918891 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:38.918891 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:38.918891 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:38.918891 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:38.919819 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:38.919819 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:38.919819 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:38.919819 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:38.919819 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:38.919819 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:38.919819 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:38.919819 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:38.919819 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:38.919819 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:38.919819 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:38.919819 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:38.919819 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:38.919819 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:38.919819 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:38.919819 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:38.920694 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:38.920694 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:38.920694 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:38.920694 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:38.920694 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:38.920694 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:38.920694 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:38.920694 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:38.920694 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:38.920694 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:38.920694 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:37:38.920694 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:38.920694 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 212/418] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jul 2 20:37:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:38.927491 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dc220-8d59-4adb-96d8-7e81d7835a7e None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:39.022299 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:39.064925 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8a3e2-ba1a-4e5e-87f8-371d20e8464e None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:39.065362 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8a3e2-ba1a-4e5e-87f8-371d20e8464e None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:39.065731 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f8a3e2-ba1a-4e5e-87f8-371d20e8464e None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:39.071023 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 213/419] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:39.076133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446a6b4-c6d6-4f19-90a7-51c7179e70a3 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:39.076416 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446a6b4-c6d6-4f19-90a7-51c7179e70a3 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:39.076688 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446a6b4-c6d6-4f19-90a7-51c7179e70a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:39.078213 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845dc220-8d59-4adb-96d8-7e81d7835a7e None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:39.113511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aabfbc-36a9-475d-90ea-8794a50429bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:39.114112 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aabfbc-36a9-475d-90ea-8794a50429bf None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:39.114402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aabfbc-36a9-475d-90ea-8794a50429bf None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:39.114681 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aabfbc-36a9-475d-90ea-8794a50429bf None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:39.115476 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aabfbc-36a9-475d-90ea-8794a50429bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:39.115789 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aabfbc-36a9-475d-90ea-8794a50429bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:39.117324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aabfbc-36a9-475d-90ea-8794a50429bf None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:39.126388 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 207/420] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:37:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:39.128092 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-0446a6b4-c6d6-4f19-90a7-51c7179e70a3 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:39.129483 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-0446a6b4-c6d6-4f19-90a7-51c7179e70a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:39.132006 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aabfbc-36a9-475d-90ea-8794a50429bf None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:39.234052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aabfbc-36a9-475d-90ea-8794a50429bf None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:39.252913 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:39.274627 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500dfd13-2656-4baf-99ae-e0e23d1728a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:39.275321 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dfd13-2656-4baf-99ae-e0e23d1728a0 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:39.275603 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dfd13-2656-4baf-99ae-e0e23d1728a0 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:39.275878 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500dfd13-2656-4baf-99ae-e0e23d1728a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:39.341018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 214/421] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:39.362885 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500dfd13-2656-4baf-99ae-e0e23d1728a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:39.364468 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500dfd13-2656-4baf-99ae-e0e23d1728a0 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:39.384398 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446a6b4-c6d6-4f19-90a7-51c7179e70a3 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:39.554815 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 208/422] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 02 20:37:39.554815 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500dfd13-2656-4baf-99ae-e0e23d1728a0 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:39.569851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446a6b4-c6d6-4f19-90a7-51c7179e70a3 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:39.571376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:39.595264 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:39.638551 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d35d6-3070-46e8-9b26-fc868c2890e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:39.639399 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d35d6-3070-46e8-9b26-fc868c2890e3 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:39.639789 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d35d6-3070-46e8-9b26-fc868c2890e3 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:39.640107 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d35d6-3070-46e8-9b26-fc868c2890e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:39.654743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500dfd13-2656-4baf-99ae-e0e23d1728a0 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:39.667818 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d35d6-3070-46e8-9b26-fc868c2890e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:39.686185 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-ea8d35d6-3070-46e8-9b26-fc868c2890e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:39.686185 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:39.686185 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:39.686185 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:39.686185 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:39.686185 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:39.686185 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:39.686185 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:39.686185 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:39.686185 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:39.686185 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:39.686185 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:39.686185 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:39.686185 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:39.686185 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:39.686185 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:39.687124 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:39.687124 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:39.687124 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:39.687124 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:39.687124 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:39.687124 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:39.687124 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:39.687124 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:39.687124 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:39.687124 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:39.687124 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:39.687124 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:39.687124 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:39.687124 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:39.687124 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:39.687124 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:39.687980 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:39.687980 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:39.687980 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:39.687980 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:39.687980 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:39.687980 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:39.687980 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:39.687980 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:39.687980 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:39.687980 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:39.687980 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:39.687980 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:39.689136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 215/423] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:37:39.693142 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802bd3b-aa10-4717-9bf9-645400d429d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:39.696916 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802bd3b-aa10-4717-9bf9-645400d429d1 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:39.696916 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802bd3b-aa10-4717-9bf9-645400d429d1 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:39.696916 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802bd3b-aa10-4717-9bf9-645400d429d1 None admin] PATH_INFO: `/v3/projects/17380892ecb2424e932154c8ad8864b7` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:39.696916 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802bd3b-aa10-4717-9bf9-645400d429d1 None admin] RBAC: Authorizing `identity:get_project(project_id=17380892ecb2424e932154c8ad8864b7)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:39.697431 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802bd3b-aa10-4717-9bf9-645400d429d1 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:39.704118 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 209/424] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:39 2022] GET /identity/v3/projects/17380892ecb2424e932154c8ad8864b7 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:39.704296 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d35d6-3070-46e8-9b26-fc868c2890e3 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:39.706966 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802bd3b-aa10-4717-9bf9-645400d429d1 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:39.796889 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:39.812997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802bd3b-aa10-4717-9bf9-645400d429d1 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:39.851120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b9ad8-3132-4e96-85c6-7cecef01aefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:39.854039 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b9ad8-3132-4e96-85c6-7cecef01aefb None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:39.855634 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b9ad8-3132-4e96-85c6-7cecef01aefb None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:39.855919 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13b9ad8-3132-4e96-85c6-7cecef01aefb None admin] PATH_INFO: `/v3/groups/848f16a4feb14c9685410c9f306b2938` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:39.857883 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b9ad8-3132-4e96-85c6-7cecef01aefb None admin] RBAC: Authorizing `identity:get_group(group_id=848f16a4feb14c9685410c9f306b2938)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:39.859375 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13b9ad8-3132-4e96-85c6-7cecef01aefb None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:39.863522 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 210/425] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jul 2 20:37:39 2022] GET /identity/v3/groups/848f16a4feb14c9685410c9f306b2938 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:39.869222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b9ad8-3132-4e96-85c6-7cecef01aefb None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:39.928969 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d35d6-3070-46e8-9b26-fc868c2890e3 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:39.973302 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13b9ad8-3132-4e96-85c6-7cecef01aefb None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:39.992405 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef028e-c342-4926-bc17-401b2c32a601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:39.993088 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef028e-c342-4926-bc17-401b2c32a601 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:39.993365 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef028e-c342-4926-bc17-401b2c32a601 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:39.993638 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ef028e-c342-4926-bc17-401b2c32a601 None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:39.994386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef028e-c342-4926-bc17-401b2c32a601 None admin] RBAC: Adding query filter params (name=member) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:39.994782 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef028e-c342-4926-bc17-401b2c32a601 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:39.996192 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ef028e-c342-4926-bc17-401b2c32a601 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:40.010605 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0059c2f-c2f8-4971-a1cd-3b04459bdfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:40.011550 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0059c2f-c2f8-4971-a1cd-3b04459bdfe9 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:40.011841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0059c2f-c2f8-4971-a1cd-3b04459bdfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:40.012155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0059c2f-c2f8-4971-a1cd-3b04459bdfe9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:40.013045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0059c2f-c2f8-4971-a1cd-3b04459bdfe9 None admin] RBAC: Adding query filter params (group.id=848f16a4feb14c9685410c9f306b2938, role.id=a03f493abb6846eebc4958aabe8b28ad, scope.project.id=17380892ecb2424e932154c8ad8864b7) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:40.013363 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0059c2f-c2f8-4971-a1cd-3b04459bdfe9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:40.013868 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 216/426] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:37:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:40.014839 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0059c2f-c2f8-4971-a1cd-3b04459bdfe9 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:40.019997 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef028e-c342-4926-bc17-401b2c32a601 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:40.021765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 211/427] 10.222.0.57 () {56 vars in 1376 bytes} [Sat Jul 2 20:37:39 2022] GET /identity/v3/role_assignments?group.id=848f16a4feb14c9685410c9f306b2938&scope.project.id=17380892ecb2424e932154c8ad8864b7&role.id=a03f493abb6846eebc4958aabe8b28ad => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:40.104224 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:40.159158 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ef028e-c342-4926-bc17-401b2c32a601 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:40.195423 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebef6f0-b4e6-4777-a2d3-53c94b4404a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:40.195999 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebef6f0-b4e6-4777-a2d3-53c94b4404a4 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:40.196275 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebef6f0-b4e6-4777-a2d3-53c94b4404a4 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:40.196543 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebef6f0-b4e6-4777-a2d3-53c94b4404a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:40.271337 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebef6f0-b4e6-4777-a2d3-53c94b4404a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:40.272930 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebef6f0-b4e6-4777-a2d3-53c94b4404a4 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:40.310230 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:40.381989 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 217/428] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 02 20:37:40.387671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0059c2f-c2f8-4971-a1cd-3b04459bdfe9 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:40.409751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:40.502508 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0059c2f-c2f8-4971-a1cd-3b04459bdfe9 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:40.541591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d027908-9a15-4dd2-bb5a-c323e4f49fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:40.542489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d027908-9a15-4dd2-bb5a-c323e4f49fb8 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:40.542769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d027908-9a15-4dd2-bb5a-c323e4f49fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:40.543072 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d027908-9a15-4dd2-bb5a-c323e4f49fb8 None admin] PATH_INFO: `/v3/projects/17380892ecb2424e932154c8ad8864b7` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:40.544385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d027908-9a15-4dd2-bb5a-c323e4f49fb8 None admin] RBAC: Authorizing `identity:get_project(project_id=17380892ecb2424e932154c8ad8864b7)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:40.545909 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d027908-9a15-4dd2-bb5a-c323e4f49fb8 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:40.548462 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 212/429] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:40 2022] GET /identity/v3/projects/17380892ecb2424e932154c8ad8864b7 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:40.554180 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebef6f0-b4e6-4777-a2d3-53c94b4404a4 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:40.659227 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebef6f0-b4e6-4777-a2d3-53c94b4404a4 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:40.693918 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ee5503-c23b-4773-9515-c7339345e571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:40.697558 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee5503-c23b-4773-9515-c7339345e571 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:40.697558 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee5503-c23b-4773-9515-c7339345e571 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:40.697558 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ee5503-c23b-4773-9515-c7339345e571 None admin] PATH_INFO: `/v3/groups/848f16a4feb14c9685410c9f306b2938` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:40.697558 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee5503-c23b-4773-9515-c7339345e571 None admin] RBAC: Authorizing `identity:get_group(group_id=848f16a4feb14c9685410c9f306b2938)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:40.697968 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ee5503-c23b-4773-9515-c7339345e571 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:40.699704 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 218/430] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jul 2 20:37:40 2022] GET /identity/v3/groups/848f16a4feb14c9685410c9f306b2938 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:40.706126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d027908-9a15-4dd2-bb5a-c323e4f49fb8 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:40.788659 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b45a61-14a1-4b6e-a75d-7a88594cf483 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:40.788957 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b45a61-14a1-4b6e-a75d-7a88594cf483 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:40.789153 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b45a61-14a1-4b6e-a75d-7a88594cf483 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:40.790732 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 219/431] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:37:40.795617 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a5c99-042d-40b8-acc6-0804642f9871 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:40.795901 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a5c99-042d-40b8-acc6-0804642f9871 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:40.796176 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7a5c99-042d-40b8-acc6-0804642f9871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:40.803865 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:40.810816 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:40.814382 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-2c7a5c99-042d-40b8-acc6-0804642f9871 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:40.815045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d027908-9a15-4dd2-bb5a-c323e4f49fb8 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:40.815979 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-2c7a5c99-042d-40b8-acc6-0804642f9871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:40.866575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf61e5-8cd5-4ff6-9b12-46505a5e12e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:40.867876 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf61e5-8cd5-4ff6-9b12-46505a5e12e8 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:40.868229 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf61e5-8cd5-4ff6-9b12-46505a5e12e8 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:40.868823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf61e5-8cd5-4ff6-9b12-46505a5e12e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:40.869751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf61e5-8cd5-4ff6-9b12-46505a5e12e8 None admin] RBAC: Adding query filter params (group.id=848f16a4feb14c9685410c9f306b2938, role.id=538580824ccd4e02823540ee3df31cdc, scope.project.id=17380892ecb2424e932154c8ad8864b7) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:40.870292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf61e5-8cd5-4ff6-9b12-46505a5e12e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:40.872166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf61e5-8cd5-4ff6-9b12-46505a5e12e8 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:40.881586 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 213/432] 10.222.0.57 () {56 vars in 1376 bytes} [Sat Jul 2 20:37:40 2022] GET /identity/v3/role_assignments?group.id=848f16a4feb14c9685410c9f306b2938&scope.project.id=17380892ecb2424e932154c8ad8864b7&role.id=538580824ccd4e02823540ee3df31cdc => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:40.895282 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 220/433] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:37:40.919609 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf61e5-8cd5-4ff6-9b12-46505a5e12e8 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:41.039215 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf61e5-8cd5-4ff6-9b12-46505a5e12e8 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:41.077095 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f9c56-3886-4feb-85e3-8c62c9dc4be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:41.078309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f9c56-3886-4feb-85e3-8c62c9dc4be1 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:41.078623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f9c56-3886-4feb-85e3-8c62c9dc4be1 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:41.078922 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f9c56-3886-4feb-85e3-8c62c9dc4be1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:41.092827 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743f9c56-3886-4feb-85e3-8c62c9dc4be1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:41.101599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-743f9c56-3886-4feb-85e3-8c62c9dc4be1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:37:41.101599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:41.101599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:41.101599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:41.101599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:41.101599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:41.101599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:41.101599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:41.101599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:41.101599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:41.101599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:41.101599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:41.101599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:41.101599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:41.101599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:41.101599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:41.103858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:41.103858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:41.103858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:41.103858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:41.103858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:41.103858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:41.103858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:41.103858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:41.103858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:41.103858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:41.103858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:41.103858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:41.103858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:41.103858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:41.103858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:41.103858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:41.105829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:41.105829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:41.105829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:41.105829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:41.105829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:41.105829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:41.105829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:41.105829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:41.105829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:41.105829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:41.105829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 02 20:37:41.105829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:41.105829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 214/434] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jul 2 20:37:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:41.111154 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a5c99-042d-40b8-acc6-0804642f9871 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:41.189124 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246539e-dc96-4b88-8836-993d5e758029 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:41.189504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246539e-dc96-4b88-8836-993d5e758029 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:41.189670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246539e-dc96-4b88-8836-993d5e758029 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:41.194391 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 215/435] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:41.200232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad379c-5aa0-4608-ad86-f2bad1481d8f None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:41.200489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad379c-5aa0-4608-ad86-f2bad1481d8f None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:41.200932 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad379c-5aa0-4608-ad86-f2bad1481d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:41.219302 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7a5c99-042d-40b8-acc6-0804642f9871 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:41.227947 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-a6ad379c-5aa0-4608-ad86-f2bad1481d8f None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:41.229157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-a6ad379c-5aa0-4608-ad86-f2bad1481d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:41.232949 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:41.259503 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0635d-5204-44ca-8c24-48a3e84ee98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:41.260499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0635d-5204-44ca-8c24-48a3e84ee98d None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:41.260499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0635d-5204-44ca-8c24-48a3e84ee98d None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:41.260810 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d0635d-5204-44ca-8c24-48a3e84ee98d None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:41.261567 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0635d-5204-44ca-8c24-48a3e84ee98d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:41.261872 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0635d-5204-44ca-8c24-48a3e84ee98d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:41.263276 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d0635d-5204-44ca-8c24-48a3e84ee98d None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:41.264813 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:41.277400 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 221/436] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:37:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:41.283192 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0635d-5204-44ca-8c24-48a3e84ee98d None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:41.329802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 216/437] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:41.331512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1d671-6a74-4157-9bf0-702784117393 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:41.331991 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1d671-6a74-4157-9bf0-702784117393 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:41.332269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba1d671-6a74-4157-9bf0-702784117393 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:41.333692 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 217/438] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:41.339663 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2a89c-7c9f-4ea8-99ec-2d6df572ed6f None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:41.340105 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2a89c-7c9f-4ea8-99ec-2d6df572ed6f None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:41.340566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2a89c-7c9f-4ea8-99ec-2d6df572ed6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:41.358658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-91a2a89c-7c9f-4ea8-99ec-2d6df572ed6f None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:41.359950 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-91a2a89c-7c9f-4ea8-99ec-2d6df572ed6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:41.415565 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d0635d-5204-44ca-8c24-48a3e84ee98d None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:41.433222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 218/439] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:41.434068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2a89c-7c9f-4ea8-99ec-2d6df572ed6f None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:41.457766 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0f2a3-0973-44ff-8fa3-41117ba8a736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:41.458520 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0f2a3-0973-44ff-8fa3-41117ba8a736 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:41.458807 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0f2a3-0973-44ff-8fa3-41117ba8a736 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:41.459121 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec0f2a3-0973-44ff-8fa3-41117ba8a736 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:41.520091 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:41.525626 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:41.532919 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0f2a3-0973-44ff-8fa3-41117ba8a736 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:41.535187 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec0f2a3-0973-44ff-8fa3-41117ba8a736 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:41.560496 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2a89c-7c9f-4ea8-99ec-2d6df572ed6f None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:41.594620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0533b8c-9af2-488f-95a2-642341bf1c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:41.595374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0533b8c-9af2-488f-95a2-642341bf1c83 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:41.595654 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0533b8c-9af2-488f-95a2-642341bf1c83 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:41.595927 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0533b8c-9af2-488f-95a2-642341bf1c83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:41.606298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0533b8c-9af2-488f-95a2-642341bf1c83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:41.614374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-e0533b8c-9af2-488f-95a2-642341bf1c83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:37:41.614374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:41.614374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:41.614374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:41.614374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:41.614374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:41.614374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:41.614374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:41.614374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:41.614374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:41.614374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:41.614374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:41.614374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:41.614374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:41.614374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:41.614374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:41.615433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:41.615433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:41.615433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:41.615433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:41.615433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:41.615433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:41.615433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:41.615433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:41.615433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:41.615433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:41.615433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:41.615433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:41.615433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:41.615433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:41.615433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:41.615433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:41.616247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:41.616247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:41.616247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:41.616247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:41.616247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:41.616247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:41.616247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:41.616247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:41.616247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:41.616247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:41.616247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:37:41.616247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:41.616247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 219/440] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jul 2 20:37:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:41.617131 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0533b8c-9af2-488f-95a2-642341bf1c83 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:41.642938 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 222/441] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 02 20:37:41.643765 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0f2a3-0973-44ff-8fa3-41117ba8a736 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:41.719566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0533b8c-9af2-488f-95a2-642341bf1c83 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:41.740852 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:41.747792 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec0f2a3-0973-44ff-8fa3-41117ba8a736 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:41.748185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:41.754413 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ba027-497d-4ed4-8a7a-a027dcd810e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:41.755247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ba027-497d-4ed4-8a7a-a027dcd810e5 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:41.755526 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ba027-497d-4ed4-8a7a-a027dcd810e5 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:41.755815 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ba027-497d-4ed4-8a7a-a027dcd810e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:41.766263 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ba027-497d-4ed4-8a7a-a027dcd810e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:41.774108 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-522ba027-497d-4ed4-8a7a-a027dcd810e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:41.774108 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:41.774108 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:41.774108 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:41.774108 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:41.774108 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:41.774108 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:41.774108 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:41.774108 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:41.774108 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:41.774108 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:41.774108 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:41.774108 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:41.774108 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:41.774108 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:41.774108 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:41.775166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:41.775166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:41.775166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:41.775166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:41.775166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:41.775166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:41.775166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:41.775166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:41.775166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:41.775166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:41.775166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:41.775166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:41.775166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:41.775166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:41.775166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:41.775166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:41.775998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:41.775998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:41.775998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:41.775998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:41.775998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:41.775998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:41.775998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:41.775998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:41.775998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:41.775998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:41.775998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 02 20:37:41.775998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:41.775998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 220/442] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:41.776636 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ba027-497d-4ed4-8a7a-a027dcd810e5 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:41.786386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffa64d-3a90-4436-9338-26488b247903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:41.787095 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffa64d-3a90-4436-9338-26488b247903 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:41.787373 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffa64d-3a90-4436-9338-26488b247903 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:41.787645 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ffa64d-3a90-4436-9338-26488b247903 None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:41.788397 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffa64d-3a90-4436-9338-26488b247903 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:41.788698 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffa64d-3a90-4436-9338-26488b247903 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:41.790091 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ffa64d-3a90-4436-9338-26488b247903 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:41.798384 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 223/443] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:41.799264 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffa64d-3a90-4436-9338-26488b247903 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:41.877657 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ba027-497d-4ed4-8a7a-a027dcd810e5 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:41.899070 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ffa64d-3a90-4436-9338-26488b247903 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:41.911112 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe9a7e-adc4-46da-9654-39ce237f9af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:41.912016 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe9a7e-adc4-46da-9654-39ce237f9af3 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:41.912333 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe9a7e-adc4-46da-9654-39ce237f9af3 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:41.912606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fe9a7e-adc4-46da-9654-39ce237f9af3 None admin] PATH_INFO: `/v3/projects/407b7d25a7944d3295a63d668b0a6a62` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:41.913824 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe9a7e-adc4-46da-9654-39ce237f9af3 None admin] RBAC: Authorizing `identity:get_project(project_id=407b7d25a7944d3295a63d668b0a6a62)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:41.915326 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fe9a7e-adc4-46da-9654-39ce237f9af3 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:41.917040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 221/444] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:41 2022] GET /identity/v3/projects/407b7d25a7944d3295a63d668b0a6a62 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:41.917795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe9a7e-adc4-46da-9654-39ce237f9af3 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:41.935555 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2dfcb-e0c3-419c-a816-6fc416cf84bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:41.936360 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2dfcb-e0c3-419c-a816-6fc416cf84bd None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:41.936634 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2dfcb-e0c3-419c-a816-6fc416cf84bd None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:41.936895 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2dfcb-e0c3-419c-a816-6fc416cf84bd None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:41.937668 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2dfcb-e0c3-419c-a816-6fc416cf84bd None admin] RBAC: Adding query filter params (name=member) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:41.937971 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2dfcb-e0c3-419c-a816-6fc416cf84bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:41.939378 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2dfcb-e0c3-419c-a816-6fc416cf84bd None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:41.947348 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 224/445] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:37:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:41.948124 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2dfcb-e0c3-419c-a816-6fc416cf84bd None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:41.969499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:41.977002 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:42.021498 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fe9a7e-adc4-46da-9654-39ce237f9af3 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:42.047163 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2dfcb-e0c3-419c-a816-6fc416cf84bd None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:42.056814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdf6a5-39d5-4ca0-be18-98aa58fe072d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:42.057444 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdf6a5-39d5-4ca0-be18-98aa58fe072d None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:42.057721 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdf6a5-39d5-4ca0-be18-98aa58fe072d None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:42.057994 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdf6a5-39d5-4ca0-be18-98aa58fe072d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:42.081342 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7336b-32ea-4177-ab46-0c6cf7b2b115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:42.082284 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7336b-32ea-4177-ab46-0c6cf7b2b115 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:42.082481 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7336b-32ea-4177-ab46-0c6cf7b2b115 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:42.082754 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7336b-32ea-4177-ab46-0c6cf7b2b115 None admin] PATH_INFO: `/v3/groups/848f16a4feb14c9685410c9f306b2938` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:42.083977 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7336b-32ea-4177-ab46-0c6cf7b2b115 None admin] RBAC: Authorizing `identity:get_group(group_id=848f16a4feb14c9685410c9f306b2938)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:42.085425 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7336b-32ea-4177-ab46-0c6cf7b2b115 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:42.087065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 225/446] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jul 2 20:37:41 2022] GET /identity/v3/groups/848f16a4feb14c9685410c9f306b2938 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:42.087806 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7336b-32ea-4177-ab46-0c6cf7b2b115 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:42.130798 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bdf6a5-39d5-4ca0-be18-98aa58fe072d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:42.132237 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bdf6a5-39d5-4ca0-be18-98aa58fe072d None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:42.175575 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:42.188037 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7336b-32ea-4177-ab46-0c6cf7b2b115 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:42.188720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:42.221883 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574955a-3acd-4ab4-9221-d9a9195f4424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:42.222582 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574955a-3acd-4ab4-9221-d9a9195f4424 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:42.222865 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574955a-3acd-4ab4-9221-d9a9195f4424 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:42.223169 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574955a-3acd-4ab4-9221-d9a9195f4424 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:42.230698 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 222/447] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:37:42.231560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdf6a5-39d5-4ca0-be18-98aa58fe072d None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:42.296649 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574955a-3acd-4ab4-9221-d9a9195f4424 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:42.298975 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574955a-3acd-4ab4-9221-d9a9195f4424 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:42.330190 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdf6a5-39d5-4ca0-be18-98aa58fe072d None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:42.364067 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b1ba3-e8f6-4ae0-a45e-62afe43ffb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:42.364722 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b1ba3-e8f6-4ae0-a45e-62afe43ffb75 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:42.365214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b1ba3-e8f6-4ae0-a45e-62afe43ffb75 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:42.365321 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b1ba3-e8f6-4ae0-a45e-62afe43ffb75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:42.366084 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b1ba3-e8f6-4ae0-a45e-62afe43ffb75 None admin] RBAC: Adding query filter params (group.id=848f16a4feb14c9685410c9f306b2938, role.id=a03f493abb6846eebc4958aabe8b28ad, scope.project.id=407b7d25a7944d3295a63d668b0a6a62) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:42.366396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b1ba3-e8f6-4ae0-a45e-62afe43ffb75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:42.367907 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b1ba3-e8f6-4ae0-a45e-62afe43ffb75 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:42.373721 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 223/448] 10.222.0.57 () {56 vars in 1376 bytes} [Sat Jul 2 20:37:42 2022] GET /identity/v3/role_assignments?group.id=848f16a4feb14c9685410c9f306b2938&scope.project.id=407b7d25a7944d3295a63d668b0a6a62&role.id=a03f493abb6846eebc4958aabe8b28ad => generated 611 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:42.374493 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b1ba3-e8f6-4ae0-a45e-62afe43ffb75 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:42.393593 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:42.405337 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:42.410303 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 226/449] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:37:42.415864 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574955a-3acd-4ab4-9221-d9a9195f4424 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:42.504324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b1ba3-e8f6-4ae0-a45e-62afe43ffb75 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:42.532929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574955a-3acd-4ab4-9221-d9a9195f4424 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:42.542363 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732486c3-0c99-4aac-bf48-8ae5ca2e65e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:42.543282 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732486c3-0c99-4aac-bf48-8ae5ca2e65e7 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:42.543566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732486c3-0c99-4aac-bf48-8ae5ca2e65e7 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:42.543848 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732486c3-0c99-4aac-bf48-8ae5ca2e65e7 None admin] PATH_INFO: `/v3/projects/48e1bdb53b064749bf22c6e982f8a7ab` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:42.545112 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732486c3-0c99-4aac-bf48-8ae5ca2e65e7 None admin] RBAC: Authorizing `identity:get_project(project_id=48e1bdb53b064749bf22c6e982f8a7ab)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:42.546603 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732486c3-0c99-4aac-bf48-8ae5ca2e65e7 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:42.549137 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 224/450] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:42 2022] GET /identity/v3/projects/48e1bdb53b064749bf22c6e982f8a7ab => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:42.554693 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732486c3-0c99-4aac-bf48-8ae5ca2e65e7 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:42.576449 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62f47c-879a-4543-abd7-c9daa1033a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:42.577437 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f47c-879a-4543-abd7-c9daa1033a5a None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:42.579007 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f47c-879a-4543-abd7-c9daa1033a5a None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:42.579007 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62f47c-879a-4543-abd7-c9daa1033a5a None admin] PATH_INFO: `/v3/projects/407b7d25a7944d3295a63d668b0a6a62` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:42.579857 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62f47c-879a-4543-abd7-c9daa1033a5a None admin] RBAC: Authorizing `identity:get_project(project_id=407b7d25a7944d3295a63d668b0a6a62)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:42.581332 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62f47c-879a-4543-abd7-c9daa1033a5a None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:42.585705 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 227/451] 10.222.0.57 () {56 vars in 1186 bytes} [Sat Jul 2 20:37:42 2022] GET /identity/v3/projects/407b7d25a7944d3295a63d668b0a6a62 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:42.588636 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62f47c-879a-4543-abd7-c9daa1033a5a None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:42.651021 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:42.658557 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:42.669220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732486c3-0c99-4aac-bf48-8ae5ca2e65e7 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:42.695366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62f47c-879a-4543-abd7-c9daa1033a5a None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:42.709781 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5cdd5-434c-491f-b88d-99102bc31579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:42.713317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5cdd5-434c-491f-b88d-99102bc31579 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:42.713317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5cdd5-434c-491f-b88d-99102bc31579 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:42.713317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae5cdd5-434c-491f-b88d-99102bc31579 None admin] PATH_INFO: `/v3/groups/73cac09c2eab4b5686f401d293e2dce4` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:42.713317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5cdd5-434c-491f-b88d-99102bc31579 None admin] RBAC: Authorizing `identity:get_group(group_id=73cac09c2eab4b5686f401d293e2dce4)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:42.713937 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae5cdd5-434c-491f-b88d-99102bc31579 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:42.715748 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 225/452] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jul 2 20:37:42 2022] GET /identity/v3/groups/73cac09c2eab4b5686f401d293e2dce4 => generated 229 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:42.721570 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5cdd5-434c-491f-b88d-99102bc31579 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:42.735236 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7667c-20b9-4003-9a29-c812799d2f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:42.736083 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7667c-20b9-4003-9a29-c812799d2f98 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:42.736386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7667c-20b9-4003-9a29-c812799d2f98 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:42.736629 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a7667c-20b9-4003-9a29-c812799d2f98 None admin] PATH_INFO: `/v3/groups/848f16a4feb14c9685410c9f306b2938` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:42.737844 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7667c-20b9-4003-9a29-c812799d2f98 None admin] RBAC: Authorizing `identity:get_group(group_id=848f16a4feb14c9685410c9f306b2938)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:42.739345 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a7667c-20b9-4003-9a29-c812799d2f98 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:42.740951 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 228/453] 10.222.0.57 () {56 vars in 1180 bytes} [Sat Jul 2 20:37:42 2022] GET /identity/v3/groups/848f16a4feb14c9685410c9f306b2938 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:42.749383 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7667c-20b9-4003-9a29-c812799d2f98 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:42.821260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae5cdd5-434c-491f-b88d-99102bc31579 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:42.846925 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a7667c-20b9-4003-9a29-c812799d2f98 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:42.854693 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b738abd-d31d-4cb9-b27d-55ddb81e5fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:42.855360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b738abd-d31d-4cb9-b27d-55ddb81e5fef None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:42.855640 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b738abd-d31d-4cb9-b27d-55ddb81e5fef None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:42.855913 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b738abd-d31d-4cb9-b27d-55ddb81e5fef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:42.856722 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b738abd-d31d-4cb9-b27d-55ddb81e5fef None admin] RBAC: Adding query filter params (group.id=73cac09c2eab4b5686f401d293e2dce4, role.id=353a58700c5640988ce2c9012e847cf8, scope.project.id=48e1bdb53b064749bf22c6e982f8a7ab) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:42.857028 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b738abd-d31d-4cb9-b27d-55ddb81e5fef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:42.858463 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b738abd-d31d-4cb9-b27d-55ddb81e5fef None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:42.864238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 226/454] 10.222.0.57 () {56 vars in 1376 bytes} [Sat Jul 2 20:37:42 2022] GET /identity/v3/role_assignments?group.id=73cac09c2eab4b5686f401d293e2dce4&scope.project.id=48e1bdb53b064749bf22c6e982f8a7ab&role.id=353a58700c5640988ce2c9012e847cf8 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:42.869996 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:42.882166 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7861d546-95b5-48fe-ab52-27b1c834d5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:42.882844 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861d546-95b5-48fe-ab52-27b1c834d5b9 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:42.883164 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861d546-95b5-48fe-ab52-27b1c834d5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:42.883438 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7861d546-95b5-48fe-ab52-27b1c834d5b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:42.884282 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861d546-95b5-48fe-ab52-27b1c834d5b9 None admin] RBAC: Adding query filter params (group.id=848f16a4feb14c9685410c9f306b2938, role.id=538580824ccd4e02823540ee3df31cdc, scope.project.id=407b7d25a7944d3295a63d668b0a6a62) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:42.884596 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861d546-95b5-48fe-ab52-27b1c834d5b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:42.886078 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7861d546-95b5-48fe-ab52-27b1c834d5b9 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:42.893237 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 229/455] 10.222.0.57 () {56 vars in 1376 bytes} [Sat Jul 2 20:37:42 2022] GET /identity/v3/role_assignments?group.id=848f16a4feb14c9685410c9f306b2938&scope.project.id=407b7d25a7944d3295a63d668b0a6a62&role.id=538580824ccd4e02823540ee3df31cdc => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:45.795819 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7467112-9e32-45ed-b2fd-4394b3338a44 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:45.796360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7467112-9e32-45ed-b2fd-4394b3338a44 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:45.796360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7467112-9e32-45ed-b2fd-4394b3338a44 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:45.798264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 227/456] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:45.803664 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3125397-7002-448c-8302-66d74bbbcf12 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:45.804536 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3125397-7002-448c-8302-66d74bbbcf12 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:45.805024 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3125397-7002-448c-8302-66d74bbbcf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:45.822777 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-d3125397-7002-448c-8302-66d74bbbcf12 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:45.824332 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-d3125397-7002-448c-8302-66d74bbbcf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:45.903588 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 230/457] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:45.925569 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7467112-9e32-45ed-b2fd-4394b3338a44 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:45.936451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b8cce-4b4e-483e-8e75-7760f93ec84b None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:45.936743 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b8cce-4b4e-483e-8e75-7760f93ec84b None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:45.937025 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b8cce-4b4e-483e-8e75-7760f93ec84b None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:45.938897 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 231/458] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:37:45.943616 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204a084-7f41-48ba-985e-ed88636b036d None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:45.943899 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204a084-7f41-48ba-985e-ed88636b036d None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:45.944178 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204a084-7f41-48ba-985e-ed88636b036d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:45.958981 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:45.961940 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-b204a084-7f41-48ba-985e-ed88636b036d None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:45.963305 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-b204a084-7f41-48ba-985e-ed88636b036d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:46.051075 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 232/459] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:37:46.062447 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7467112-9e32-45ed-b2fd-4394b3338a44 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:46.072163 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204a084-7f41-48ba-985e-ed88636b036d None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:46.106954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9d3073-74e1-42d1-81ee-64ef47a97b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:46.107873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d3073-74e1-42d1-81ee-64ef47a97b7e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:46.108265 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d3073-74e1-42d1-81ee-64ef47a97b7e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:46.108537 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9d3073-74e1-42d1-81ee-64ef47a97b7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:46.119372 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d3073-74e1-42d1-81ee-64ef47a97b7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:46.120882 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9d3073-74e1-42d1-81ee-64ef47a97b7e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:46.124410 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:46.139517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-5e9d3073-74e1-42d1-81ee-64ef47a97b7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:46.139517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:46.139517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:46.139517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:46.139517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:46.139517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:46.139517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:46.139517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:46.139517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:46.139517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:46.139517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:46.139517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:46.139517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:37:46.139517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:37:46.139517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:37:46.140392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:37:46.140392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:46.140392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:46.140392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:46.140392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:46.140392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:46.140392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:46.140392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:46.140392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:46.140392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:46.140392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:46.140392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:46.140392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:46.140392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:46.140392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:46.140392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:46.140392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:46.141288 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:37:46.141288 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:37:46.141288 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:46.141288 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:46.141288 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 228/460] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:46.142041 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fc332-4615-404a-9cc5-a6d18b8527d1 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:46.142335 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fc332-4615-404a-9cc5-a6d18b8527d1 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:46.142609 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fc332-4615-404a-9cc5-a6d18b8527d1 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:46.147727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 229/461] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:46.147727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fc332-4615-404a-9cc5-a6d18b8527d1 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:46.186254 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204a084-7f41-48ba-985e-ed88636b036d None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:46.223553 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1593a1-1f6e-4be7-94c5-a619cab17c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:46.224376 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1593a1-1f6e-4be7-94c5-a619cab17c71 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:46.224639 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1593a1-1f6e-4be7-94c5-a619cab17c71 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:46.224911 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1593a1-1f6e-4be7-94c5-a619cab17c71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:46.231346 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:46.237076 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1593a1-1f6e-4be7-94c5-a619cab17c71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:46.238980 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1593a1-1f6e-4be7-94c5-a619cab17c71 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:46.257689 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fc332-4615-404a-9cc5-a6d18b8527d1 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:46.258138 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-2c1593a1-1f6e-4be7-94c5-a619cab17c71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:46.258138 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:46.258138 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:46.258138 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:46.258138 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:46.258138 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:46.258138 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:46.258138 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:46.258138 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:46.258138 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:46.258138 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:46.258138 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:46.258138 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:37:46.258138 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:37:46.258138 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:37:46.259126 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:37:46.259126 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:46.259126 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:46.259126 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:46.259126 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:46.259126 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:46.259126 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:46.259126 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:46.259126 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:46.259126 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:46.259126 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:46.259126 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:46.259126 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:46.259126 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:46.259126 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:46.259126 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:46.259126 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:46.259981 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:37:46.259981 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:37:46.259981 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:46.259981 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:46.263044 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 233/462] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:37:46.264520 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb29a4-3cb9-4df4-b4b6-b0c22412fd20 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:46.264834 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb29a4-3cb9-4df4-b4b6-b0c22412fd20 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:46.265113 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb29a4-3cb9-4df4-b4b6-b0c22412fd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:46.281090 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-45eb29a4-3cb9-4df4-b4b6-b0c22412fd20 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:46.282380 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-45eb29a4-3cb9-4df4-b4b6-b0c22412fd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:46.291018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89165496-079d-4dd7-8111-9d0a260976a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:46.291676 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89165496-079d-4dd7-8111-9d0a260976a0 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:46.291955 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89165496-079d-4dd7-8111-9d0a260976a0 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:46.292224 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89165496-079d-4dd7-8111-9d0a260976a0 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:46.292930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89165496-079d-4dd7-8111-9d0a260976a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:46.293232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89165496-079d-4dd7-8111-9d0a260976a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:46.294600 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89165496-079d-4dd7-8111-9d0a260976a0 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:46.312081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 230/463] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:46.314062 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c59361-e337-4ead-81d3-8c67b8b8fd9c None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:46.314620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c59361-e337-4ead-81d3-8c67b8b8fd9c None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:46.314932 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c59361-e337-4ead-81d3-8c67b8b8fd9c None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:46.316176 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 231/464] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:46.317051 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c59361-e337-4ead-81d3-8c67b8b8fd9c None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:46.351650 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 234/465] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:46.352555 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb29a4-3cb9-4df4-b4b6-b0c22412fd20 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:46.388608 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:46.432667 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c59361-e337-4ead-81d3-8c67b8b8fd9c None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:46.457162 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eb29a4-3cb9-4df4-b4b6-b0c22412fd20 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:46.465959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75e6dd-e721-4d5e-aacb-b76765dcaa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:46.466621 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75e6dd-e721-4d5e-aacb-b76765dcaa30 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:46.466896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75e6dd-e721-4d5e-aacb-b76765dcaa30 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:46.467194 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75e6dd-e721-4d5e-aacb-b76765dcaa30 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:46.467907 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75e6dd-e721-4d5e-aacb-b76765dcaa30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:46.468202 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75e6dd-e721-4d5e-aacb-b76765dcaa30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:46.469703 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75e6dd-e721-4d5e-aacb-b76765dcaa30 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:46.471145 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:46.486780 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 232/466] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:46.486780 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5868e-0a43-4ee7-a4ec-c46d6c2469f8 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:46.486780 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5868e-0a43-4ee7-a4ec-c46d6c2469f8 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:46.486780 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5868e-0a43-4ee7-a4ec-c46d6c2469f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:46.495156 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da9aa1-6bd3-427b-aace-043ab1bf082a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:46.495828 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da9aa1-6bd3-427b-aace-043ab1bf082a None admin] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:46.496115 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da9aa1-6bd3-427b-aace-043ab1bf082a None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:46.496373 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da9aa1-6bd3-427b-aace-043ab1bf082a None admin] PATH_INFO: `/v3/users` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:46.497069 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da9aa1-6bd3-427b-aace-043ab1bf082a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:46.498529 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da9aa1-6bd3-427b-aace-043ab1bf082a None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:46.500576 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-68c5868e-0a43-4ee7-a4ec-c46d6c2469f8 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:46.501828 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-68c5868e-0a43-4ee7-a4ec-c46d6c2469f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:46.520244 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 235/467] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jul 2 20:37:46 2022] POST /identity/v3/users => generated 246 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:37:46.521118 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da9aa1-6bd3-427b-aace-043ab1bf082a None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:46.604584 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 233/468] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:46.605997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5868e-0a43-4ee7-a4ec-c46d6c2469f8 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:46.636349 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:46.657904 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da9aa1-6bd3-427b-aace-043ab1bf082a None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:46.698511 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0ef92-718c-42a1-8926-01f79739117c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:46.699363 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0ef92-718c-42a1-8926-01f79739117c None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:46.699647 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0ef92-718c-42a1-8926-01f79739117c None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:46.699922 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0ef92-718c-42a1-8926-01f79739117c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:46.714675 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0ef92-718c-42a1-8926-01f79739117c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:46.715657 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff0ef92-718c-42a1-8926-01f79739117c None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:46.725241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5868e-0a43-4ee7-a4ec-c46d6c2469f8 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:46.738559 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-0ff0ef92-718c-42a1-8926-01f79739117c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:46.738559 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:46.738559 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:46.738559 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:46.738559 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:46.738559 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:46.738559 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:46.738559 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:46.738559 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:46.738559 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:46.738559 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:46.738559 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:46.738559 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:37:46.738559 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:37:46.738559 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:37:46.739580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:37:46.739580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:46.739580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:46.739580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:46.739580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:46.739580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:46.739580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:46.739580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:46.739580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:46.739580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:46.739580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:46.739580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:46.739580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:46.739580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:46.739580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:46.739580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:46.739580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:46.740598 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:37:46.740598 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:37:46.740598 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:46.740598 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:46.740598 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 236/469] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:46.741012 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0ef92-718c-42a1-8926-01f79739117c None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:46.753216 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:46.770321 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabef28-d516-4e3f-a32a-cf4c72ae25e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:46.771066 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabef28-d516-4e3f-a32a-cf4c72ae25e6 None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:46.771351 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabef28-d516-4e3f-a32a-cf4c72ae25e6 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:46.771620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aabef28-d516-4e3f-a32a-cf4c72ae25e6 None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:46.772418 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabef28-d516-4e3f-a32a-cf4c72ae25e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:46.774590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aabef28-d516-4e3f-a32a-cf4c72ae25e6 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:46.804749 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 234/470] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jul 2 20:37:46 2022] POST /identity/v3/users => generated 248 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:37:46.804749 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabef28-d516-4e3f-a32a-cf4c72ae25e6 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:46.871307 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0ef92-718c-42a1-8926-01f79739117c None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:46.916819 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351b210-64c1-4336-a2a4-24cb0b952829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:46.917726 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351b210-64c1-4336-a2a4-24cb0b952829 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:46.918075 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351b210-64c1-4336-a2a4-24cb0b952829 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:46.918412 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0351b210-64c1-4336-a2a4-24cb0b952829 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:46.927563 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:46.933872 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351b210-64c1-4336-a2a4-24cb0b952829 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:46.935382 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0351b210-64c1-4336-a2a4-24cb0b952829 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:46.947821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aabef28-d516-4e3f-a32a-cf4c72ae25e6 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:46.992357 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb201d4-6396-4b5d-b61e-7166a1696e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:46.993458 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb201d4-6396-4b5d-b61e-7166a1696e0d None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:46.993936 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb201d4-6396-4b5d-b61e-7166a1696e0d None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:46.994454 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb201d4-6396-4b5d-b61e-7166a1696e0d None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:46.995505 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb201d4-6396-4b5d-b61e-7166a1696e0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:46.996056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb201d4-6396-4b5d-b61e-7166a1696e0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:46.997814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb201d4-6396-4b5d-b61e-7166a1696e0d None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:47.013020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 235/471] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:47.019316 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb201d4-6396-4b5d-b61e-7166a1696e0d None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:47.078877 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:47.081728 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-0351b210-64c1-4336-a2a4-24cb0b952829 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:47.081728 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:47.081728 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:47.081728 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:47.081728 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:47.081728 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:47.081728 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:47.081728 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:47.081728 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:47.081728 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:47.081728 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:47.081728 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:47.081728 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:37:47.081728 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:37:47.081728 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:37:47.082556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:37:47.082556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:47.082556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:47.082556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:47.082556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:47.082556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:47.082556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:47.082556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:47.082556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:47.082556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:47.082556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:47.082556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:47.082556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:47.082556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:47.082556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:47.082556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:47.082556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:47.083530 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:37:47.083530 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:37:47.083530 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:47.083530 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:47.083530 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 237/472] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:47.094564 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351b210-64c1-4336-a2a4-24cb0b952829 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:47.151730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb201d4-6396-4b5d-b61e-7166a1696e0d None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:47.188849 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15f76c-b465-4297-8973-8ef052a94a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:47.189535 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15f76c-b465-4297-8973-8ef052a94a31 None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:47.189818 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15f76c-b465-4297-8973-8ef052a94a31 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:47.190093 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c15f76c-b465-4297-8973-8ef052a94a31 None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:47.190805 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15f76c-b465-4297-8973-8ef052a94a31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:47.192492 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c15f76c-b465-4297-8973-8ef052a94a31 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:47.216461 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0351b210-64c1-4336-a2a4-24cb0b952829 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:47.220022 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 236/473] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jul 2 20:37:47 2022] POST /identity/v3/users => generated 248 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:37:47.261417 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a577b418-3267-4745-9779-ca90f9440b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:47.262112 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577b418-3267-4745-9779-ca90f9440b6f None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:47.262394 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577b418-3267-4745-9779-ca90f9440b6f None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:47.262702 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a577b418-3267-4745-9779-ca90f9440b6f None admin] PATH_INFO: `/v3/domains` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:47.263481 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577b418-3267-4745-9779-ca90f9440b6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:47.263788 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577b418-3267-4745-9779-ca90f9440b6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:47.265302 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a577b418-3267-4745-9779-ca90f9440b6f None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:47.279353 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 238/474] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:47.285043 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15f76c-b465-4297-8973-8ef052a94a31 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:47.395993 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:47.402675 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c15f76c-b465-4297-8973-8ef052a94a31 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:47.440354 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bccbbd-24c4-4289-9108-8a060591beb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:47.441057 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bccbbd-24c4-4289-9108-8a060591beb7 None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:47.441320 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bccbbd-24c4-4289-9108-8a060591beb7 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:47.441593 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bccbbd-24c4-4289-9108-8a060591beb7 None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:47.442374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bccbbd-24c4-4289-9108-8a060591beb7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:47.444056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bccbbd-24c4-4289-9108-8a060591beb7 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:47.467931 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 237/475] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jul 2 20:37:47 2022] POST /identity/v3/users => generated 249 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:37:48.949832 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd06f5-e878-4fea-99da-2dc6fcc44908 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:48.950369 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd06f5-e878-4fea-99da-2dc6fcc44908 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:48.950369 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dd06f5-e878-4fea-99da-2dc6fcc44908 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:48.952042 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 239/476] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:48.959653 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf2722-d447-4cfd-ada5-39d0ecf5755a None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:48.959653 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf2722-d447-4cfd-ada5-39d0ecf5755a None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:48.959653 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bf2722-d447-4cfd-ada5-39d0ecf5755a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:48.976319 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-57bf2722-d447-4cfd-ada5-39d0ecf5755a None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:48.977729 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-57bf2722-d447-4cfd-ada5-39d0ecf5755a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:49.046277 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 238/477] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:49.072136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd06f5-e878-4fea-99da-2dc6fcc44908 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:49.126851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:49.180446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dd06f5-e878-4fea-99da-2dc6fcc44908 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:49.215621 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67182a40-3fea-48bf-a259-63430ca87afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:49.216430 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67182a40-3fea-48bf-a259-63430ca87afd None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:49.216712 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67182a40-3fea-48bf-a259-63430ca87afd None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:49.216987 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67182a40-3fea-48bf-a259-63430ca87afd None admin] PATH_INFO: `/v3/roles/service` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:49.228053 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67182a40-3fea-48bf-a259-63430ca87afd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:49.236116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-67182a40-3fea-48bf-a259-63430ca87afd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:37:49.236116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:49.236116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:49.236116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:49.236116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:49.236116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:49.236116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:49.236116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:49.236116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:49.236116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:49.236116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:49.236116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:49.236116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:49.236116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:49.236116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:49.236116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:49.237004 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:49.237004 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:49.237004 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:49.237004 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:49.237004 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:49.237004 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:49.237004 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:49.237004 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:49.237004 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:49.237004 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:49.237004 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:49.237004 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:49.237004 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:49.237004 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:49.237004 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:49.237004 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:49.238217 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:49.238217 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:49.238217 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:49.238217 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:49.238217 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:49.238217 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:49.238217 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:49.238217 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:49.238217 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:49.238217 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:49.238217 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:37:49.238217 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:49.238217 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 240/478] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jul 2 20:37:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:49.245151 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf2722-d447-4cfd-ada5-39d0ecf5755a None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:49.296281 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609916cb-8970-464e-a890-ac4463d14aa7 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:49.296615 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609916cb-8970-464e-a890-ac4463d14aa7 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:49.296912 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609916cb-8970-464e-a890-ac4463d14aa7 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:49.299165 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 241/479] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:37:49.303696 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7781e-22dd-4064-af82-68af10feeda1 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:49.304195 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7781e-22dd-4064-af82-68af10feeda1 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:49.304679 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b7781e-22dd-4064-af82-68af10feeda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:49.324696 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-e6b7781e-22dd-4064-af82-68af10feeda1 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:49.325898 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-e6b7781e-22dd-4064-af82-68af10feeda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:49.340757 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:49.357452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bf2722-d447-4cfd-ada5-39d0ecf5755a None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:49.396015 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac754fff-f4fb-4c93-a53e-0e142826ef2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:49.396800 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac754fff-f4fb-4c93-a53e-0e142826ef2e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:49.397146 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac754fff-f4fb-4c93-a53e-0e142826ef2e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:49.397487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac754fff-f4fb-4c93-a53e-0e142826ef2e None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:49.398306 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac754fff-f4fb-4c93-a53e-0e142826ef2e None admin] RBAC: Adding query filter params (name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:49.398675 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac754fff-f4fb-4c93-a53e-0e142826ef2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:49.400197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac754fff-f4fb-4c93-a53e-0e142826ef2e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:49.418948 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 239/480] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jul 2 20:37:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:49.418948 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac754fff-f4fb-4c93-a53e-0e142826ef2e None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:49.419178 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 242/481] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:37:49.441500 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7781e-22dd-4064-af82-68af10feeda1 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:49.500724 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:49.531382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac754fff-f4fb-4c93-a53e-0e142826ef2e None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:49.568986 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d7f27-9006-4ffa-adff-ea4f7779157b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:49.570137 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d7f27-9006-4ffa-adff-ea4f7779157b None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:49.570651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d7f27-9006-4ffa-adff-ea4f7779157b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:49.571180 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d7f27-9006-4ffa-adff-ea4f7779157b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:49.578268 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b7781e-22dd-4064-af82-68af10feeda1 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:49.584915 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d7f27-9006-4ffa-adff-ea4f7779157b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:49.586464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d7f27-9006-4ffa-adff-ea4f7779157b None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:49.589576 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:49.607810 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-e29d7f27-9006-4ffa-adff-ea4f7779157b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:49.607810 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:49.607810 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:49.607810 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:49.607810 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:49.607810 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:49.607810 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:49.607810 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:49.607810 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:49.607810 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:49.607810 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:49.607810 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:49.607810 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:37:49.607810 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:37:49.607810 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:37:49.608775 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:37:49.608775 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:49.608775 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:49.608775 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:49.608775 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:49.608775 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:49.608775 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:49.608775 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:49.608775 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:49.608775 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:49.608775 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:49.608775 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:49.608775 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:49.608775 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:49.608775 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:49.608775 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:49.608775 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:49.609654 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:37:49.609654 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:37:49.609654 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:49.609654 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:49.614389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 240/482] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:37:49.615696 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d7f27-9006-4ffa-adff-ea4f7779157b None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:49.619569 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b84645-9842-4d4f-a00b-cd947ed3113d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:49.620747 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b84645-9842-4d4f-a00b-cd947ed3113d None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:49.621221 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b84645-9842-4d4f-a00b-cd947ed3113d None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:49.621676 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b84645-9842-4d4f-a00b-cd947ed3113d None admin] PATH_INFO: `/v3/roles/service` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:49.633389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b84645-9842-4d4f-a00b-cd947ed3113d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:49.642035 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-92b84645-9842-4d4f-a00b-cd947ed3113d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:37:49.642035 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:49.642035 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:49.642035 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:49.642035 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:49.642035 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:49.642035 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:49.642035 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:49.642035 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:49.642035 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:49.642035 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:49.642035 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:49.642035 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:49.642035 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:49.642035 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:49.642035 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:49.642899 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:49.642899 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:49.642899 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:49.642899 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:49.642899 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:49.642899 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:49.642899 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:49.642899 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:49.642899 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:49.642899 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:49.642899 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:49.642899 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:49.642899 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:49.642899 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:49.642899 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:49.642899 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:49.643726 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:49.643726 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:49.643726 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:49.643726 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:49.643726 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:49.643726 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:49.643726 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:49.643726 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:49.643726 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:49.643726 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:49.643726 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:37:49.643726 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:49.651145 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 243/483] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jul 2 20:37:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:37:49.653202 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b84645-9842-4d4f-a00b-cd947ed3113d None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:49.745737 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d7f27-9006-4ffa-adff-ea4f7779157b None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:49.781807 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2e032-0662-49fe-be63-0bcdba6c04b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:49.782469 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2e032-0662-49fe-be63-0bcdba6c04b1 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:49.782750 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2e032-0662-49fe-be63-0bcdba6c04b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:49.783207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2e032-0662-49fe-be63-0bcdba6c04b1 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:49.784441 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2e032-0662-49fe-be63-0bcdba6c04b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:49.784441 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2e032-0662-49fe-be63-0bcdba6c04b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:49.785451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2e032-0662-49fe-be63-0bcdba6c04b1 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:49.785999 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:49.789528 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b84645-9842-4d4f-a00b-cd947ed3113d None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:49.799911 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 241/484] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:49.805792 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbe38d-3f32-4c58-bee5-fdcd600f58f8 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:49.806080 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbe38d-3f32-4c58-bee5-fdcd600f58f8 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:49.806363 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febbe38d-3f32-4c58-bee5-fdcd600f58f8 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:49.807792 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 242/485] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:49.808387 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbe38d-3f32-4c58-bee5-fdcd600f58f8 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:49.834043 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e358f02-2e4f-4a46-82dc-3ccd896eae15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:49.834999 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e358f02-2e4f-4a46-82dc-3ccd896eae15 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:49.835285 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e358f02-2e4f-4a46-82dc-3ccd896eae15 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:49.835881 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e358f02-2e4f-4a46-82dc-3ccd896eae15 None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:49.836906 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e358f02-2e4f-4a46-82dc-3ccd896eae15 None admin] RBAC: Adding query filter params (name=service) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:49.837217 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e358f02-2e4f-4a46-82dc-3ccd896eae15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:49.839077 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e358f02-2e4f-4a46-82dc-3ccd896eae15 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:49.849605 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 244/486] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jul 2 20:37:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:49.850826 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d85b23-1e10-4b29-84b9-120c00cc5835 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:49.851147 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d85b23-1e10-4b29-84b9-120c00cc5835 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:49.851415 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d85b23-1e10-4b29-84b9-120c00cc5835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:49.870832 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-99d85b23-1e10-4b29-84b9-120c00cc5835 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:49.872186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:49.872574 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-99d85b23-1e10-4b29-84b9-120c00cc5835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:49.917077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febbe38d-3f32-4c58-bee5-fdcd600f58f8 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:49.943344 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 245/487] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:49.944263 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d85b23-1e10-4b29-84b9-120c00cc5835 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:49.951873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4d4ef-0e27-4177-85de-0c1f632c2f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:49.953152 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4d4ef-0e27-4177-85de-0c1f632c2f7e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:49.953446 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4d4ef-0e27-4177-85de-0c1f632c2f7e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:49.953710 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4d4ef-0e27-4177-85de-0c1f632c2f7e None admin] PATH_INFO: `/v3/users/nova` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:49.961927 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4d4ef-0e27-4177-85de-0c1f632c2f7e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:49.963583 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d4d4ef-0e27-4177-85de-0c1f632c2f7e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:49.979519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-e3d4d4ef-0e27-4177-85de-0c1f632c2f7e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:37:49.979519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:49.979519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:49.979519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:49.979519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:49.979519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:49.979519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:49.979519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:49.979519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:49.979519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:49.979519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:49.979519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:49.979519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:37:49.979519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:37:49.979519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:37:49.979519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:37:49.980424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:49.980424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:49.980424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:37:49.980424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:37:49.980424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:37:49.980424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:37:49.980424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:49.980424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:49.980424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:49.980424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:49.980424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:49.980424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:49.980424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:49.980424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:49.980424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:49.980424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:49.980424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:49.980424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:49.981348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:49.981348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:49.981348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:37:49.981348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:37:49.981348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:37:49.981348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:37:49.981348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:37:49.981348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:37:49.981348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:37:49.981348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:49.981348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 243/488] 10.222.0.57 () {56 vars in 1093 bytes} [Sat Jul 2 20:37:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:49.981937 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e1aa5-2bb6-4d4d-b85b-010254228df2 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:49.982220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e1aa5-2bb6-4d4d-b85b-010254228df2 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:49.982507 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e1aa5-2bb6-4d4d-b85b-010254228df2 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:49.983740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 244/489] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:49.984598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e1aa5-2bb6-4d4d-b85b-010254228df2 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:50.041328 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:50.050249 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d85b23-1e10-4b29-84b9-120c00cc5835 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:50.083790 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a7391-7121-4d90-a710-0e1a548b0eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:50.084580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a7391-7121-4d90-a710-0e1a548b0eb5 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:50.084706 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e1aa5-2bb6-4d4d-b85b-010254228df2 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:50.084855 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a7391-7121-4d90-a710-0e1a548b0eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:50.085120 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a7391-7121-4d90-a710-0e1a548b0eb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:50.095169 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a7391-7121-4d90-a710-0e1a548b0eb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:50.096606 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a7391-7121-4d90-a710-0e1a548b0eb5 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:50.101568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:50.114436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-ad6a7391-7121-4d90-a710-0e1a548b0eb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:50.114436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:50.114436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:50.114436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:50.114436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:50.114436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:50.114436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:50.114436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:50.114436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:50.114436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:50.114436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:50.114436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:50.114436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:37:50.114436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:37:50.114436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:37:50.115499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:37:50.115499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:50.115499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:50.115499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:50.115499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:50.115499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:50.115499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:50.115499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:50.115499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:50.115499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:50.115499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:50.115499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:50.115499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:50.115499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:50.115499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:50.115499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:50.115499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:50.116360 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:37:50.116360 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:37:50.116360 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:50.116360 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:50.116360 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 246/490] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:50.116615 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a7391-7121-4d90-a710-0e1a548b0eb5 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:50.124826 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c4065-9665-4603-8801-675d0eb20ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:50.126051 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c4065-9665-4603-8801-675d0eb20ea0 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:50.126336 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c4065-9665-4603-8801-675d0eb20ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:50.126607 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c4065-9665-4603-8801-675d0eb20ea0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:50.137545 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c4065-9665-4603-8801-675d0eb20ea0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:50.145331 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-af1c4065-9665-4603-8801-675d0eb20ea0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:37:50.145331 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:50.145331 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:50.145331 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:50.145331 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:50.145331 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:50.145331 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:50.145331 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:50.145331 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:50.145331 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:50.145331 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:50.145331 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:50.145331 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:50.145331 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:50.145331 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:50.145331 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:50.146238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:50.146238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:50.146238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:50.146238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:50.146238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:50.146238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:50.146238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:50.146238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:50.146238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:50.146238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:50.146238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:50.146238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:50.146238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:50.146238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:50.146238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:50.146238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:50.147163 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:50.147163 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:50.147163 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:50.147163 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:50.147163 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:50.147163 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:50.147163 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:50.147163 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:50.147163 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:50.147163 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:50.147163 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:37:50.147163 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:50.147163 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 245/491] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jul 2 20:37:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:50.147815 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e9e71-94ee-41be-ad61-8ba19130554f None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:50.148011 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e9e71-94ee-41be-ad61-8ba19130554f None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:50.148207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e9e71-94ee-41be-ad61-8ba19130554f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:50.164246 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-a21e9e71-94ee-41be-ad61-8ba19130554f None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:50.165464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-a21e9e71-94ee-41be-ad61-8ba19130554f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:50.218722 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a7391-7121-4d90-a710-0e1a548b0eb5 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:50.230841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 246/492] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:50.231699 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e9e71-94ee-41be-ad61-8ba19130554f None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:50.256348 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83a08e-45b7-416c-bf63-1d4d2c618a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:50.257030 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83a08e-45b7-416c-bf63-1d4d2c618a79 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:50.257308 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83a08e-45b7-416c-bf63-1d4d2c618a79 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:50.257583 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83a08e-45b7-416c-bf63-1d4d2c618a79 None admin] PATH_INFO: `/v3/users` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:50.258436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83a08e-45b7-416c-bf63-1d4d2c618a79 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:50.258745 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83a08e-45b7-416c-bf63-1d4d2c618a79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:50.260225 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83a08e-45b7-416c-bf63-1d4d2c618a79 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:50.297311 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 247/493] 10.222.0.57 () {56 vars in 1133 bytes} [Sat Jul 2 20:37:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:50.298278 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83a08e-45b7-416c-bf63-1d4d2c618a79 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:50.303482 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:50.329043 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e9e71-94ee-41be-ad61-8ba19130554f None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:50.336343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:50.362814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d93a1a-3ea6-4db4-962a-d5df76c06c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:50.363494 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d93a1a-3ea6-4db4-962a-d5df76c06c5f None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:50.364031 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d93a1a-3ea6-4db4-962a-d5df76c06c5f None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:50.364031 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d93a1a-3ea6-4db4-962a-d5df76c06c5f None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:50.364740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d93a1a-3ea6-4db4-962a-d5df76c06c5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:50.365037 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d93a1a-3ea6-4db4-962a-d5df76c06c5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:50.366422 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d93a1a-3ea6-4db4-962a-d5df76c06c5f None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:50.377601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 247/494] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:50.378380 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d93a1a-3ea6-4db4-962a-d5df76c06c5f None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:50.405222 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83a08e-45b7-416c-bf63-1d4d2c618a79 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:50.440161 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d95255-c5af-4e08-827f-5077a59c1127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:50.440823 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d95255-c5af-4e08-827f-5077a59c1127 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:50.441170 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d95255-c5af-4e08-827f-5077a59c1127 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:50.441357 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d95255-c5af-4e08-827f-5077a59c1127 None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:50.442120 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d95255-c5af-4e08-827f-5077a59c1127 None admin] RBAC: Adding query filter params (name=service) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:50.442419 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d95255-c5af-4e08-827f-5077a59c1127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:50.443841 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d95255-c5af-4e08-827f-5077a59c1127 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:50.452189 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 248/495] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jul 2 20:37:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:50.453339 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d95255-c5af-4e08-827f-5077a59c1127 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:50.479855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d93a1a-3ea6-4db4-962a-d5df76c06c5f None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:50.513324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5956c-f45e-4efb-b506-39ffca41348e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:50.514124 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5956c-f45e-4efb-b506-39ffca41348e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:50.514410 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5956c-f45e-4efb-b506-39ffca41348e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:50.514679 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e5956c-f45e-4efb-b506-39ffca41348e None admin] PATH_INFO: `/v3/roles/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:50.514858 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:50.524965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e5956c-f45e-4efb-b506-39ffca41348e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:50.532802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-16e5956c-f45e-4efb-b506-39ffca41348e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:37:50.532802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:50.532802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:50.532802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:50.532802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:50.532802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:50.532802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:50.532802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:50.532802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:50.532802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:50.532802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:50.532802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:50.532802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:50.532802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:50.532802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:50.532802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:50.533845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:50.533845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:50.533845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:50.533845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:50.533845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:50.533845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:50.533845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:50.533845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:50.533845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:50.533845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:50.533845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:50.533845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:50.533845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:50.533845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:50.533845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:50.533845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:50.534942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:50.534942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:50.534942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:50.534942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:50.534942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:50.534942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:50.534942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:50.534942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:50.534942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:50.534942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:50.534942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:37:50.534942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:50.534942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 248/496] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jul 2 20:37:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:50.535928 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5956c-f45e-4efb-b506-39ffca41348e None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:50.557749 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d95255-c5af-4e08-827f-5077a59c1127 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:50.562798 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:50.592333 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb122b6-4899-4d32-85fb-dc8a698cfe3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:50.592981 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb122b6-4899-4d32-85fb-dc8a698cfe3c None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:50.593259 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb122b6-4899-4d32-85fb-dc8a698cfe3c None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:50.593532 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb122b6-4899-4d32-85fb-dc8a698cfe3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:50.641715 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e5956c-f45e-4efb-b506-39ffca41348e None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:50.675903 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb122b6-4899-4d32-85fb-dc8a698cfe3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:50.677537 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb122b6-4899-4d32-85fb-dc8a698cfe3c None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:50.678000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e9f34-b826-45c7-964d-933c2c029a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:50.682453 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e9f34-b826-45c7-964d-933c2c029a56 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:50.682453 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e9f34-b826-45c7-964d-933c2c029a56 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:50.682453 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e9f34-b826-45c7-964d-933c2c029a56 None admin] PATH_INFO: `/v3/users/glance` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:50.693010 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e9f34-b826-45c7-964d-933c2c029a56 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:50.696244 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e9f34-b826-45c7-964d-933c2c029a56 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:50.714089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-d24e9f34-b826-45c7-964d-933c2c029a56 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 02 20:37:50.714089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:50.714089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:50.714089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:50.714089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:50.714089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:50.714089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:50.714089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:50.714089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:50.714089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:50.714089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:50.714089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:50.714089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:37:50.714089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:37:50.714089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:37:50.714089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:37:50.715226 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:50.715226 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:50.715226 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:37:50.715226 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:37:50.715226 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:37:50.715226 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:37:50.715226 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:50.715226 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:50.715226 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:50.715226 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:50.715226 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:50.715226 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:50.715226 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:50.715226 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:50.715226 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:50.715226 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:50.715226 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:50.715226 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:50.721060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:50.721060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:50.721060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:37:50.721060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:37:50.721060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:37:50.721060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:37:50.721060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:37:50.721060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:37:50.721060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 02 20:37:50.721060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:50.721060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 249/497] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:50.721060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e9f34-b826-45c7-964d-933c2c029a56 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:50.753144 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:50.794221 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 249/498] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:37:50.795093 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb122b6-4899-4d32-85fb-dc8a698cfe3c None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:50.809208 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:50.826453 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e9f34-b826-45c7-964d-933c2c029a56 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:50.870446 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca92d3a-34d3-4c7e-94fe-b0df03a00441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:50.871338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca92d3a-34d3-4c7e-94fe-b0df03a00441 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:50.871618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca92d3a-34d3-4c7e-94fe-b0df03a00441 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:50.871888 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca92d3a-34d3-4c7e-94fe-b0df03a00441 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:50.882689 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca92d3a-34d3-4c7e-94fe-b0df03a00441 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:50.884270 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca92d3a-34d3-4c7e-94fe-b0df03a00441 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:50.900955 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb122b6-4899-4d32-85fb-dc8a698cfe3c None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:50.902394 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-bca92d3a-34d3-4c7e-94fe-b0df03a00441 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:50.902394 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:50.902394 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:50.902394 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:50.902394 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:50.902394 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:50.902394 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:50.902394 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:50.902394 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:50.902394 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:50.902394 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:50.902394 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:50.902394 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:37:50.902394 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:37:50.902394 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:37:50.903260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:37:50.903260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:50.903260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:50.903260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:50.903260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:50.903260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:50.903260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:50.903260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:50.903260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:50.903260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:50.903260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:50.903260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:50.903260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:50.903260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:50.903260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:50.903260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:50.903260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:50.904076 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:37:50.904076 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:37:50.904076 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:50.904076 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:50.904076 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 250/499] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:50.905681 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca92d3a-34d3-4c7e-94fe-b0df03a00441 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:50.940555 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3934c-c842-47cc-a99b-c6afbedacd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:50.941232 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3934c-c842-47cc-a99b-c6afbedacd6b None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:50.941509 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3934c-c842-47cc-a99b-c6afbedacd6b None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:50.941781 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f3934c-c842-47cc-a99b-c6afbedacd6b None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:50.942520 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3934c-c842-47cc-a99b-c6afbedacd6b None admin] RBAC: Adding query filter params (name=service) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:50.942819 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3934c-c842-47cc-a99b-c6afbedacd6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:50.944224 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f3934c-c842-47cc-a99b-c6afbedacd6b None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:50.952324 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 250/500] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jul 2 20:37:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:50.953521 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3934c-c842-47cc-a99b-c6afbedacd6b None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:50.979853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:51.013461 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca92d3a-34d3-4c7e-94fe-b0df03a00441 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:51.046934 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182dd33-0482-4ddc-acfd-76f4fc8fe9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:51.047745 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182dd33-0482-4ddc-acfd-76f4fc8fe9e9 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:51.048140 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182dd33-0482-4ddc-acfd-76f4fc8fe9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:51.048140 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182dd33-0482-4ddc-acfd-76f4fc8fe9e9 None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:51.048988 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182dd33-0482-4ddc-acfd-76f4fc8fe9e9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:51.049293 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182dd33-0482-4ddc-acfd-76f4fc8fe9e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:51.050728 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182dd33-0482-4ddc-acfd-76f4fc8fe9e9 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:51.055539 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f3934c-c842-47cc-a99b-c6afbedacd6b None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:51.068232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:51.088383 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 251/501] 10.222.0.57 () {56 vars in 1137 bytes} [Sat Jul 2 20:37:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:51.089195 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182dd33-0482-4ddc-acfd-76f4fc8fe9e9 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:51.094591 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216401b-e833-4353-9694-f1357c8bdb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:51.095412 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216401b-e833-4353-9694-f1357c8bdb7f None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:51.095692 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216401b-e833-4353-9694-f1357c8bdb7f None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:51.095957 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f216401b-e833-4353-9694-f1357c8bdb7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:51.106811 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216401b-e833-4353-9694-f1357c8bdb7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:51.108290 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f216401b-e833-4353-9694-f1357c8bdb7f None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:51.126260 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-f216401b-e833-4353-9694-f1357c8bdb7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:51.126260 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:51.126260 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:51.126260 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:51.126260 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:51.126260 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:51.126260 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:51.126260 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:51.126260 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:51.126260 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:51.126260 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:51.126260 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:51.126260 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:37:51.126260 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:37:51.126260 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:37:51.127286 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:37:51.127286 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:51.127286 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:51.127286 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:51.127286 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:51.127286 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:51.127286 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:51.127286 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:51.127286 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:51.127286 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:51.127286 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:51.127286 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:51.127286 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:51.127286 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:51.127286 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:51.127286 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:51.127286 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:51.132929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:37:51.132929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:37:51.132929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:51.132929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:51.132929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 251/502] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:51.132929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216401b-e833-4353-9694-f1357c8bdb7f None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:51.194933 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182dd33-0482-4ddc-acfd-76f4fc8fe9e9 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:51.206363 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:51.229077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fc8c4-59aa-45fe-8777-02e809968106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:51.229745 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fc8c4-59aa-45fe-8777-02e809968106 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:51.230027 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fc8c4-59aa-45fe-8777-02e809968106 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:51.230302 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875fc8c4-59aa-45fe-8777-02e809968106 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:51.231060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fc8c4-59aa-45fe-8777-02e809968106 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:51.231366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fc8c4-59aa-45fe-8777-02e809968106 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:51.232771 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875fc8c4-59aa-45fe-8777-02e809968106 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:51.233358 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f216401b-e833-4353-9694-f1357c8bdb7f None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:51.244269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 252/503] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:51.245139 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fc8c4-59aa-45fe-8777-02e809968106 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:51.268026 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc90a30-ec8b-40c6-a417-a02b3557d15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:51.268832 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc90a30-ec8b-40c6-a417-a02b3557d15e None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:51.269110 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc90a30-ec8b-40c6-a417-a02b3557d15e None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:51.269373 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc90a30-ec8b-40c6-a417-a02b3557d15e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:51.279656 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc90a30-ec8b-40c6-a417-a02b3557d15e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:51.281226 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc90a30-ec8b-40c6-a417-a02b3557d15e None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:51.299919 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-0dc90a30-ec8b-40c6-a417-a02b3557d15e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:51.299919 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:51.299919 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:51.299919 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:51.299919 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:51.299919 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:51.299919 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:51.299919 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:51.299919 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:51.299919 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:51.299919 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:51.299919 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:51.299919 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:37:51.299919 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:37:51.299919 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:37:51.300960 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:37:51.300960 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:51.300960 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:51.300960 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:51.300960 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:51.300960 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:51.300960 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:51.300960 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:51.300960 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:51.300960 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:51.300960 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:51.300960 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:51.300960 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:51.300960 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:51.300960 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:51.300960 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:51.300960 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:51.306723 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:37:51.306723 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:37:51.306723 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:51.306723 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:51.306723 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 252/504] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:51.306723 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc90a30-ec8b-40c6-a417-a02b3557d15e None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:51.309378 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:51.355128 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875fc8c4-59aa-45fe-8777-02e809968106 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:51.389983 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a10b39-4778-4baa-b18b-866ac3da5143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:51.390666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a10b39-4778-4baa-b18b-866ac3da5143 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:51.390983 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a10b39-4778-4baa-b18b-866ac3da5143 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:51.391257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a10b39-4778-4baa-b18b-866ac3da5143 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:51.397925 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc90a30-ec8b-40c6-a417-a02b3557d15e None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:51.428213 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:51.434168 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89dd85-9bf8-41aa-a81e-e78dd759a560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:51.434830 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89dd85-9bf8-41aa-a81e-e78dd759a560 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:51.435144 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89dd85-9bf8-41aa-a81e-e78dd759a560 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:51.435401 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca89dd85-9bf8-41aa-a81e-e78dd759a560 None admin] PATH_INFO: `/v3/domains` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:51.436124 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89dd85-9bf8-41aa-a81e-e78dd759a560 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:51.436425 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89dd85-9bf8-41aa-a81e-e78dd759a560 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:51.438050 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca89dd85-9bf8-41aa-a81e-e78dd759a560 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:51.449701 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 253/505] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:51.450577 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89dd85-9bf8-41aa-a81e-e78dd759a560 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:51.461943 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a10b39-4778-4baa-b18b-866ac3da5143 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:51.463488 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a10b39-4778-4baa-b18b-866ac3da5143 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:51.519705 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:51.549585 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca89dd85-9bf8-41aa-a81e-e78dd759a560 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:51.564054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 253/506] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:37:51.564874 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a10b39-4778-4baa-b18b-866ac3da5143 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:51.584448 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f8052-3f63-49cb-8475-a2b4a2b7eeb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:51.585256 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f8052-3f63-49cb-8475-a2b4a2b7eeb2 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:51.585533 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f8052-3f63-49cb-8475-a2b4a2b7eeb2 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:51.586085 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f8052-3f63-49cb-8475-a2b4a2b7eeb2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:51.593208 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f8052-3f63-49cb-8475-a2b4a2b7eeb2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:51.594736 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f8052-3f63-49cb-8475-a2b4a2b7eeb2 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:51.610295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-d19f8052-3f63-49cb-8475-a2b4a2b7eeb2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 02 20:37:51.610295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:51.610295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:51.610295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:51.610295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:51.610295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:51.610295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:51.610295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:51.610295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:51.610295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:51.610295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:51.610295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:51.610295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:37:51.610295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:37:51.610295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:37:51.610295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:37:51.611366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:51.611366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:51.611366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:37:51.611366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:37:51.611366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:37:51.611366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:37:51.611366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:51.611366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:51.611366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:51.611366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:51.611366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:51.611366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:51.611366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:51.611366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:51.611366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:51.611366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:51.611366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:51.611366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:51.612312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:51.612312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:51.612312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:37:51.612312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:37:51.612312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:37:51.612312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:37:51.612312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:37:51.612312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:37:51.612312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 02 20:37:51.612312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:51.612312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 254/507] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:51.612312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f8052-3f63-49cb-8475-a2b4a2b7eeb2 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:51.665524 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:51.669204 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a10b39-4778-4baa-b18b-866ac3da5143 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:51.703844 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfb1a0-2744-4a10-9257-37c2f3022055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:51.704503 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfb1a0-2744-4a10-9257-37c2f3022055 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:51.704776 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfb1a0-2744-4a10-9257-37c2f3022055 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:51.705046 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cfb1a0-2744-4a10-9257-37c2f3022055 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:51.705759 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cfb1a0-2744-4a10-9257-37c2f3022055 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:51.706060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cfb1a0-2744-4a10-9257-37c2f3022055 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:51.707511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cfb1a0-2744-4a10-9257-37c2f3022055 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:51.717100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f8052-3f63-49cb-8475-a2b4a2b7eeb2 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:51.719100 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 254/508] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:51.720023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfb1a0-2744-4a10-9257-37c2f3022055 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:51.738443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:51.756324 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a219e-b03b-4f70-bace-e29302c283f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:51.757120 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a219e-b03b-4f70-bace-e29302c283f8 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:51.757398 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a219e-b03b-4f70-bace-e29302c283f8 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:51.757666 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a219e-b03b-4f70-bace-e29302c283f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:51.764327 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a219e-b03b-4f70-bace-e29302c283f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:51.765877 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961a219e-b03b-4f70-bace-e29302c283f8 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:51.780068 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-961a219e-b03b-4f70-bace-e29302c283f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:37:51.780068 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:51.780068 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:51.780068 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:51.780068 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:51.780068 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:51.780068 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:51.780068 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:51.780068 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:51.780068 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:51.780068 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:51.780068 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:51.780068 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:37:51.780068 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:37:51.780068 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:37:51.780933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:37:51.780933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:51.780933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:51.780933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:51.780933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:51.780933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:51.780933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:51.780933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:51.780933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:51.780933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:51.780933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:51.780933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:51.780933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:51.780933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:51.780933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:51.780933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:51.780933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:51.782209 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:37:51.782209 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:37:51.782209 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:37:51.782209 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:37:51.782209 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:37:51.782209 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:37:51.782209 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:37:51.782209 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:51.782209 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 255/509] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:37:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:51.782875 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a219e-b03b-4f70-bace-e29302c283f8 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:51.824654 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cfb1a0-2744-4a10-9257-37c2f3022055 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:51.858120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb47fdc-645f-450f-99bb-ed0bd4676426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:51.858897 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb47fdc-645f-450f-99bb-ed0bd4676426 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:51.859238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb47fdc-645f-450f-99bb-ed0bd4676426 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:51.859530 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb47fdc-645f-450f-99bb-ed0bd4676426 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:51.870390 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb47fdc-645f-450f-99bb-ed0bd4676426 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:51.871817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb47fdc-645f-450f-99bb-ed0bd4676426 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:51.880474 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a219e-b03b-4f70-bace-e29302c283f8 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:51.888743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-feb47fdc-645f-450f-99bb-ed0bd4676426 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:51.888743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:51.888743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:51.888743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:51.888743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:51.888743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:51.888743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:51.888743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:51.888743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:51.888743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:51.888743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:51.888743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:51.888743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:37:51.888743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:37:51.888743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:37:51.889590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:37:51.889590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:51.889590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:51.889590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:51.889590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:51.889590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:51.889590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:51.889590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:51.889590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:51.889590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:51.889590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:51.889590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:51.889590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:51.889590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:51.889590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:51.889590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:51.889590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:51.890422 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:37:51.890422 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:37:51.890422 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:51.890422 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:51.890422 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 255/510] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:51.890724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb47fdc-645f-450f-99bb-ed0bd4676426 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:51.893195 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:51.918168 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95d22d-3170-49ab-973e-8340efa0d98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:51.918840 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95d22d-3170-49ab-973e-8340efa0d98c None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:51.919142 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95d22d-3170-49ab-973e-8340efa0d98c None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:51.919410 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95d22d-3170-49ab-973e-8340efa0d98c None admin] PATH_INFO: `/v3/users` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:51.920246 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95d22d-3170-49ab-973e-8340efa0d98c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:51.920544 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95d22d-3170-49ab-973e-8340efa0d98c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:51.922096 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95d22d-3170-49ab-973e-8340efa0d98c None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:51.939007 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 256/511] 10.222.0.57 () {56 vars in 1137 bytes} [Sat Jul 2 20:37:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:51.939823 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95d22d-3170-49ab-973e-8340efa0d98c None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:51.957947 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:51.991987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb47fdc-645f-450f-99bb-ed0bd4676426 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:52.027633 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239093a3-22e8-4482-ab39-9bc963cf1fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:52.028459 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239093a3-22e8-4482-ab39-9bc963cf1fb6 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:52.028736 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239093a3-22e8-4482-ab39-9bc963cf1fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:52.029016 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239093a3-22e8-4482-ab39-9bc963cf1fb6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:52.036624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239093a3-22e8-4482-ab39-9bc963cf1fb6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:52.038106 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239093a3-22e8-4482-ab39-9bc963cf1fb6 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:52.038884 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95d22d-3170-49ab-973e-8340efa0d98c None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:52.052290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-239093a3-22e8-4482-ab39-9bc963cf1fb6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 02 20:37:52.052290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:52.052290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:52.052290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:52.052290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:52.052290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:52.052290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:52.052290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:52.052290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:52.052290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:52.052290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:52.052290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:52.052290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:37:52.052290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:37:52.052290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:37:52.052290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:37:52.053241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:52.053241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:52.053241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:37:52.053241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:37:52.053241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:37:52.053241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:37:52.053241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:52.053241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:52.053241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:52.053241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:52.053241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:52.053241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:52.053241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:52.053241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:52.053241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:52.053241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:52.053241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:52.053241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:52.054132 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:52.054132 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:52.054132 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:37:52.054132 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:37:52.054132 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:37:52.054132 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:37:52.054132 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:37:52.054132 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:37:52.054132 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 02 20:37:52.054132 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:52.054132 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 256/512] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jul 2 20:37:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:52.054679 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239093a3-22e8-4482-ab39-9bc963cf1fb6 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:52.078896 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638320b3-6b1c-42c1-8955-8ef6170b77ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:52.079586 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638320b3-6b1c-42c1-8955-8ef6170b77ef None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:52.079863 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638320b3-6b1c-42c1-8955-8ef6170b77ef None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:52.080134 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638320b3-6b1c-42c1-8955-8ef6170b77ef None admin] PATH_INFO: `/v3/projects` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:52.080922 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638320b3-6b1c-42c1-8955-8ef6170b77ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:52.081229 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638320b3-6b1c-42c1-8955-8ef6170b77ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:52.082668 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638320b3-6b1c-42c1-8955-8ef6170b77ef None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:52.100242 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 257/513] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jul 2 20:37:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:52.101044 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638320b3-6b1c-42c1-8955-8ef6170b77ef None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:52.130017 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:52.156496 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239093a3-22e8-4482-ab39-9bc963cf1fb6 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:52.181784 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:52.190423 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b4031-9e4f-4154-be58-45d47c2dfdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:52.191110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b4031-9e4f-4154-be58-45d47c2dfdfc None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:52.191394 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b4031-9e4f-4154-be58-45d47c2dfdfc None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:52.191668 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320b4031-9e4f-4154-be58-45d47c2dfdfc None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:52.192388 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b4031-9e4f-4154-be58-45d47c2dfdfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:52.192689 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b4031-9e4f-4154-be58-45d47c2dfdfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:52.194079 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320b4031-9e4f-4154-be58-45d47c2dfdfc None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:52.200956 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638320b3-6b1c-42c1-8955-8ef6170b77ef None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:52.206075 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 257/514] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:52.206860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b4031-9e4f-4154-be58-45d47c2dfdfc None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:52.238914 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c45de6-13a5-4a53-be7a-b609301f9ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:52.239841 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c45de6-13a5-4a53-be7a-b609301f9ff2 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:52.240123 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c45de6-13a5-4a53-be7a-b609301f9ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:52.240398 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c45de6-13a5-4a53-be7a-b609301f9ff2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:52.311274 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c45de6-13a5-4a53-be7a-b609301f9ff2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:52.312900 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c45de6-13a5-4a53-be7a-b609301f9ff2 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:52.313824 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320b4031-9e4f-4154-be58-45d47c2dfdfc None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:52.339646 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:52.347925 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d6f7d-ad4c-47e8-92ba-9c5fa8a79724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:52.348589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d6f7d-ad4c-47e8-92ba-9c5fa8a79724 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:52.348886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d6f7d-ad4c-47e8-92ba-9c5fa8a79724 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:52.349152 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d6f7d-ad4c-47e8-92ba-9c5fa8a79724 None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:52.349977 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d6f7d-ad4c-47e8-92ba-9c5fa8a79724 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:52.350280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d6f7d-ad4c-47e8-92ba-9c5fa8a79724 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:52.351752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d6f7d-ad4c-47e8-92ba-9c5fa8a79724 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:52.369328 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 258/515] 10.222.0.57 () {56 vars in 1139 bytes} [Sat Jul 2 20:37:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:52.370121 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d6f7d-ad4c-47e8-92ba-9c5fa8a79724 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:52.412885 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 258/516] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:37:52.413659 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c45de6-13a5-4a53-be7a-b609301f9ff2 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:52.417868 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:52.470361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d6f7d-ad4c-47e8-92ba-9c5fa8a79724 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:52.503522 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5003378-47f9-477d-8e48-0f53fafcff90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:52.504193 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5003378-47f9-477d-8e48-0f53fafcff90 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:52.504476 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5003378-47f9-477d-8e48-0f53fafcff90 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:52.504750 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5003378-47f9-477d-8e48-0f53fafcff90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:52.505571 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5003378-47f9-477d-8e48-0f53fafcff90 None admin] RBAC: Adding query filter params (role.id=09c018c7ef5249efb8f68eb74acafe13, scope.project.id=cd684ec63e1c4d61819302c837dd4349, user.id=eec825336f2e408ebabdcfd29845d5ad) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:52.505867 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5003378-47f9-477d-8e48-0f53fafcff90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:52.507355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5003378-47f9-477d-8e48-0f53fafcff90 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:52.512705 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 259/517] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:37:52 2022] GET /identity/v3/role_assignments?user.id=eec825336f2e408ebabdcfd29845d5ad&scope.project.id=cd684ec63e1c4d61819302c837dd4349&role.id=09c018c7ef5249efb8f68eb74acafe13 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:52.513179 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c45de6-13a5-4a53-be7a-b609301f9ff2 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:52.513621 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5003378-47f9-477d-8e48-0f53fafcff90 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:52.545203 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:52.555620 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5628dc6-ca63-462f-bb8f-5fd732a83bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:52.556518 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5628dc6-ca63-462f-bb8f-5fd732a83bd3 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:52.556861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5628dc6-ca63-462f-bb8f-5fd732a83bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:52.557172 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5628dc6-ca63-462f-bb8f-5fd732a83bd3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:52.565034 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5628dc6-ca63-462f-bb8f-5fd732a83bd3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:52.566602 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5628dc6-ca63-462f-bb8f-5fd732a83bd3 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:52.581720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-c5628dc6-ca63-462f-bb8f-5fd732a83bd3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:37:52.581720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:52.581720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:52.581720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:52.581720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:52.581720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:52.581720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:52.581720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:52.581720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:52.581720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:52.581720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:52.581720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:52.581720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:37:52.581720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:37:52.581720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:37:52.582786 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:37:52.582786 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:52.582786 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:52.582786 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:52.582786 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:52.582786 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:52.582786 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:52.582786 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:52.582786 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:52.582786 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:52.582786 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:52.582786 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:52.582786 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:52.582786 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:52.582786 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:52.582786 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:52.582786 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:52.583842 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:37:52.583842 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:37:52.583842 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:37:52.583842 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:37:52.583842 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:37:52.583842 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:37:52.583842 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:37:52.583842 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:52.588292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 259/518] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:37:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:52.589085 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5628dc6-ca63-462f-bb8f-5fd732a83bd3 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:52.639419 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5003378-47f9-477d-8e48-0f53fafcff90 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:52.651614 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:52.678830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a14d58-368a-4e4d-930b-50bbd46721b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:52.679879 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a14d58-368a-4e4d-930b-50bbd46721b8 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:52.680164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a14d58-368a-4e4d-930b-50bbd46721b8 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:52.680435 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a14d58-368a-4e4d-930b-50bbd46721b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:52.713043 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5628dc6-ca63-462f-bb8f-5fd732a83bd3 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:52.750892 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ccb9c-7228-4faf-a009-b59f01eb21fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:52.751723 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ccb9c-7228-4faf-a009-b59f01eb21fa None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:52.752003 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ccb9c-7228-4faf-a009-b59f01eb21fa None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:52.752362 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ccb9c-7228-4faf-a009-b59f01eb21fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:52.755809 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a14d58-368a-4e4d-930b-50bbd46721b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:52.757378 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a14d58-368a-4e4d-930b-50bbd46721b8 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:52.763624 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ccb9c-7228-4faf-a009-b59f01eb21fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:52.765074 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3ccb9c-7228-4faf-a009-b59f01eb21fa None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:52.784982 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-be3ccb9c-7228-4faf-a009-b59f01eb21fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:52.784982 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:52.784982 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:52.784982 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:52.784982 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:52.784982 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:52.784982 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:52.784982 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:52.784982 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:52.784982 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:52.784982 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:52.784982 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:52.784982 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:37:52.784982 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:37:52.784982 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:37:52.785857 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:37:52.785857 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:52.785857 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:52.785857 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:52.785857 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:52.785857 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:52.785857 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:52.785857 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:52.785857 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:52.785857 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:52.785857 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:52.785857 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:52.785857 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:52.785857 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:52.785857 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:52.785857 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:52.785857 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:52.786686 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:37:52.786686 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:37:52.786686 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:52.786686 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:52.786686 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 260/519] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:52.786686 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ccb9c-7228-4faf-a009-b59f01eb21fa None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:52.830288 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:52.875821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 260/520] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:37:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:37:52.876972 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a14d58-368a-4e4d-930b-50bbd46721b8 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:52.890055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:52.895307 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ccb9c-7228-4faf-a009-b59f01eb21fa None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:52.931538 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0dc5b9-c863-4886-9810-995fedbd5478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:52.932115 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dc5b9-c863-4886-9810-995fedbd5478 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:52.932395 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dc5b9-c863-4886-9810-995fedbd5478 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:52.932913 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0dc5b9-c863-4886-9810-995fedbd5478 None admin] PATH_INFO: `/v3/projects` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:52.933435 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0dc5b9-c863-4886-9810-995fedbd5478 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:52.933740 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0dc5b9-c863-4886-9810-995fedbd5478 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:52.935270 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0dc5b9-c863-4886-9810-995fedbd5478 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:52.953676 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 261/521] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jul 2 20:37:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:52.954584 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0dc5b9-c863-4886-9810-995fedbd5478 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:52.981638 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a14d58-368a-4e4d-930b-50bbd46721b8 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:53.061253 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:53.065322 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0dc5b9-c863-4886-9810-995fedbd5478 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:53.104338 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf734a-0ac3-49a7-bcc2-3b194851ad9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:53.105131 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf734a-0ac3-49a7-bcc2-3b194851ad9b None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:53.105409 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf734a-0ac3-49a7-bcc2-3b194851ad9b None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:53.105670 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf734a-0ac3-49a7-bcc2-3b194851ad9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:53.117599 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf734a-0ac3-49a7-bcc2-3b194851ad9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:53.119081 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf734a-0ac3-49a7-bcc2-3b194851ad9b None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:53.136624 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-14cf734a-0ac3-49a7-bcc2-3b194851ad9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:53.136624 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:53.136624 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:53.136624 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:53.136624 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:53.136624 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:53.136624 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:53.136624 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:53.136624 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:53.136624 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:53.136624 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:53.136624 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:53.136624 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:37:53.136624 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:37:53.136624 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:37:53.137497 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:37:53.137497 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:53.137497 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:53.137497 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:53.137497 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:53.137497 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:53.137497 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:53.137497 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:53.137497 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:53.137497 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:53.137497 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:53.137497 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:53.137497 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:53.137497 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:53.137497 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:53.137497 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:53.137497 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:53.138319 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:37:53.138319 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:37:53.138319 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:53.138319 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:53.138319 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 262/522] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:53.138586 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf734a-0ac3-49a7-bcc2-3b194851ad9b None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:53.147315 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677d748-3856-47bc-86b7-7b81cbb6ae31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:53.148060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677d748-3856-47bc-86b7-7b81cbb6ae31 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:53.148345 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677d748-3856-47bc-86b7-7b81cbb6ae31 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:53.148616 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8677d748-3856-47bc-86b7-7b81cbb6ae31 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:53.149330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677d748-3856-47bc-86b7-7b81cbb6ae31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:53.149644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677d748-3856-47bc-86b7-7b81cbb6ae31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:53.151049 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8677d748-3856-47bc-86b7-7b81cbb6ae31 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:53.162727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 261/523] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:53.163581 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677d748-3856-47bc-86b7-7b81cbb6ae31 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:53.246955 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:53.259480 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf734a-0ac3-49a7-bcc2-3b194851ad9b None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:53.279737 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8677d748-3856-47bc-86b7-7b81cbb6ae31 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:53.298210 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4775c-5140-454f-a61e-e67a670ad5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:53.298863 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4775c-5140-454f-a61e-e67a670ad5c5 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:53.299173 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4775c-5140-454f-a61e-e67a670ad5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:53.299446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4775c-5140-454f-a61e-e67a670ad5c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:53.300709 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4775c-5140-454f-a61e-e67a670ad5c5 None admin] RBAC: Adding query filter params (role.id=09c018c7ef5249efb8f68eb74acafe13, scope.project.id=cd684ec63e1c4d61819302c837dd4349, user.id=bb3685e7474a40b0ba9115283446d430) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:53.301022 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4775c-5140-454f-a61e-e67a670ad5c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:53.302472 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4775c-5140-454f-a61e-e67a670ad5c5 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:53.308647 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 263/524] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:37:53 2022] GET /identity/v3/role_assignments?user.id=bb3685e7474a40b0ba9115283446d430&scope.project.id=cd684ec63e1c4d61819302c837dd4349&role.id=09c018c7ef5249efb8f68eb74acafe13 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:53.309212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4775c-5140-454f-a61e-e67a670ad5c5 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:53.314878 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53e597-37d0-4d7a-be58-f146af9db9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:53.315590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53e597-37d0-4d7a-be58-f146af9db9cc None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:53.315868 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53e597-37d0-4d7a-be58-f146af9db9cc None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:53.316137 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe53e597-37d0-4d7a-be58-f146af9db9cc None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:53.316871 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53e597-37d0-4d7a-be58-f146af9db9cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:53.317173 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53e597-37d0-4d7a-be58-f146af9db9cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:53.318594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe53e597-37d0-4d7a-be58-f146af9db9cc None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:53.342660 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 262/525] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:53.343721 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:53.350480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53e597-37d0-4d7a-be58-f146af9db9cc None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:53.438742 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4775c-5140-454f-a61e-e67a670ad5c5 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:53.483935 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba73c5d-0385-4593-9192-789a3b1f5883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:53.484809 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe53e597-37d0-4d7a-be58-f146af9db9cc None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:53.484936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba73c5d-0385-4593-9192-789a3b1f5883 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:53.485092 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba73c5d-0385-4593-9192-789a3b1f5883 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:53.485447 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba73c5d-0385-4593-9192-789a3b1f5883 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:53.493233 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba73c5d-0385-4593-9192-789a3b1f5883 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:53.494712 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba73c5d-0385-4593-9192-789a3b1f5883 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:53.511725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-bba73c5d-0385-4593-9192-789a3b1f5883 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:37:53.511725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:53.511725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:53.511725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:53.511725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:53.511725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:53.511725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:53.511725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:53.511725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:53.511725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:53.511725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:53.511725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:53.511725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:37:53.511725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:37:53.511725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:37:53.512787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:37:53.512787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:53.512787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:53.512787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:53.512787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:53.512787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:53.512787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:53.512787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:53.512787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:53.512787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:53.512787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:53.512787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:53.512787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:53.512787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:53.512787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:53.512787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:53.512787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:53.514055 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:37:53.514055 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:37:53.514055 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:37:53.514055 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:37:53.514055 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:37:53.514055 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:37:53.514055 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:37:53.514055 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:53.514055 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 264/526] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:37:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:53.519012 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba73c5d-0385-4593-9192-789a3b1f5883 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:53.523841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:53.533142 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ba468-5510-47ec-8194-35769790d863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:53.534475 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ba468-5510-47ec-8194-35769790d863 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:53.534848 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ba468-5510-47ec-8194-35769790d863 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:53.535233 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965ba468-5510-47ec-8194-35769790d863 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:53.548055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ba468-5510-47ec-8194-35769790d863 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:53.551588 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965ba468-5510-47ec-8194-35769790d863 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:53.567317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-965ba468-5510-47ec-8194-35769790d863 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:37:53.567317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:53.567317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:53.567317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:53.567317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:53.567317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:53.567317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:53.567317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:53.567317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:53.567317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:53.567317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:53.567317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:53.567317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:37:53.567317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:37:53.567317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:37:53.568443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:37:53.568443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:53.568443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:53.568443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:53.568443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:53.568443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:53.568443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:53.568443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:53.568443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:53.568443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:53.568443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:53.568443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:53.568443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:53.568443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:53.568443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:53.568443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:53.568443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:53.569489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:37:53.569489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:37:53.569489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:37:53.569489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:37:53.569489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:37:53.569489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:37:53.569489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:37:53.569489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:53.571242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 263/527] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:37:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:53.579857 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ba468-5510-47ec-8194-35769790d863 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:53.613105 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:53.638622 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba73c5d-0385-4593-9192-789a3b1f5883 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:53.678510 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bea7c-1859-4697-b9c4-cc28f00f14b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:53.679227 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bea7c-1859-4697-b9c4-cc28f00f14b4 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:53.679717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bea7c-1859-4697-b9c4-cc28f00f14b4 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:53.679879 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bea7c-1859-4697-b9c4-cc28f00f14b4 None admin] PATH_INFO: `/v3/projects` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:53.680678 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bea7c-1859-4697-b9c4-cc28f00f14b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:53.680985 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bea7c-1859-4697-b9c4-cc28f00f14b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:53.682430 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bea7c-1859-4697-b9c4-cc28f00f14b4 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:53.700767 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 265/528] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jul 2 20:37:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:53.703680 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bea7c-1859-4697-b9c4-cc28f00f14b4 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:53.704132 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965ba468-5510-47ec-8194-35769790d863 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:53.744935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3d2f6-7ddf-4d10-9cee-2f3a327084a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:53.745892 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3d2f6-7ddf-4d10-9cee-2f3a327084a1 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:53.746317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3d2f6-7ddf-4d10-9cee-2f3a327084a1 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:53.746731 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f3d2f6-7ddf-4d10-9cee-2f3a327084a1 None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:53.747718 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3d2f6-7ddf-4d10-9cee-2f3a327084a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:53.748275 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3d2f6-7ddf-4d10-9cee-2f3a327084a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:53.749918 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f3d2f6-7ddf-4d10-9cee-2f3a327084a1 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:53.771194 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 264/529] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jul 2 20:37:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:53.777652 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3d2f6-7ddf-4d10-9cee-2f3a327084a1 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:53.831088 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:53.833713 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bea7c-1859-4697-b9c4-cc28f00f14b4 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:53.878857 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7157aa-e004-4a68-b49a-be87e6fde28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:53.879646 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7157aa-e004-4a68-b49a-be87e6fde28f None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:53.879991 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7157aa-e004-4a68-b49a-be87e6fde28f None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:53.880351 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7157aa-e004-4a68-b49a-be87e6fde28f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:53.881256 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7157aa-e004-4a68-b49a-be87e6fde28f None admin] RBAC: Adding query filter params (role.id=09c018c7ef5249efb8f68eb74acafe13, scope.project.id=cd684ec63e1c4d61819302c837dd4349, user.id=875c7134ed804201831348457be9d247) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:53.881630 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7157aa-e004-4a68-b49a-be87e6fde28f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:53.889997 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7157aa-e004-4a68-b49a-be87e6fde28f None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:53.890126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f3d2f6-7ddf-4d10-9cee-2f3a327084a1 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:53.890680 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:53.894575 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 266/530] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:37:53 2022] GET /identity/v3/role_assignments?user.id=875c7134ed804201831348457be9d247&scope.project.id=cd684ec63e1c4d61819302c837dd4349&role.id=09c018c7ef5249efb8f68eb74acafe13 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:53.927847 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f899f7-c634-4456-b737-f5a40e5d43a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:53.928576 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f899f7-c634-4456-b737-f5a40e5d43a2 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:53.928855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f899f7-c634-4456-b737-f5a40e5d43a2 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:53.929121 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f899f7-c634-4456-b737-f5a40e5d43a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:53.930058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f899f7-c634-4456-b737-f5a40e5d43a2 None admin] RBAC: Adding query filter params (role.id=09c018c7ef5249efb8f68eb74acafe13, scope.project.id=cd684ec63e1c4d61819302c837dd4349, user.id=bfcc022be567428db48e7b2a71d9c069) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:53.930363 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f899f7-c634-4456-b737-f5a40e5d43a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:53.931930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f899f7-c634-4456-b737-f5a40e5d43a2 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:53.938899 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 265/531] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:37:53 2022] GET /identity/v3/role_assignments?user.id=bfcc022be567428db48e7b2a71d9c069&scope.project.id=cd684ec63e1c4d61819302c837dd4349&role.id=09c018c7ef5249efb8f68eb74acafe13 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:37:54.862632 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7cada-d147-4520-90bd-914266e6867c None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:54.863206 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7cada-d147-4520-90bd-914266e6867c None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:54.863206 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7cada-d147-4520-90bd-914266e6867c None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:54.864910 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 267/532] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:54.870313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2ddd1-b83d-4109-be77-03103d24ee59 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:54.870752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2ddd1-b83d-4109-be77-03103d24ee59 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:54.870956 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b2ddd1-b83d-4109-be77-03103d24ee59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:54.888451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-a7b2ddd1-b83d-4109-be77-03103d24ee59 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:54.889647 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-a7b2ddd1-b83d-4109-be77-03103d24ee59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:54.966002 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 266/533] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:54.990231 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7cada-d147-4520-90bd-914266e6867c None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:55.106027 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7cada-d147-4520-90bd-914266e6867c None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:55.141751 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2cd1a-abb2-45f9-a9cd-9f0e3f8010bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:55.142544 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2cd1a-abb2-45f9-a9cd-9f0e3f8010bb None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:55.142819 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2cd1a-abb2-45f9-a9cd-9f0e3f8010bb None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:55.143115 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f2cd1a-abb2-45f9-a9cd-9f0e3f8010bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:55.153999 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f2cd1a-abb2-45f9-a9cd-9f0e3f8010bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:55.161890 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-d4f2cd1a-abb2-45f9-a9cd-9f0e3f8010bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:37:55.161890 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:55.161890 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:55.161890 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:55.161890 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:55.161890 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:55.161890 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:55.161890 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:55.161890 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:55.161890 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:55.161890 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:55.161890 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:55.161890 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:55.161890 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:55.161890 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:55.161890 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:55.162888 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:55.162888 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:55.162888 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:55.162888 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:55.162888 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:55.162888 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:55.162888 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:55.162888 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:55.162888 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:55.162888 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:55.162888 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:55.162888 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:55.162888 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:55.162888 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:55.162888 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:55.162888 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:55.163787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:55.163787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:55.163787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:55.163787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:55.163787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:55.163787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:55.163787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:55.163787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:55.163787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:55.163787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:55.163787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:37:55.163787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:55.163787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 268/534] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jul 2 20:37:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:55.171149 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2ddd1-b83d-4109-be77-03103d24ee59 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:55.218953 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:55.278148 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b2ddd1-b83d-4109-be77-03103d24ee59 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:55.314002 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6f003-4956-48ec-8d08-ef09ba3bf84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:55.315130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6f003-4956-48ec-8d08-ef09ba3bf84e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:55.315677 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6f003-4956-48ec-8d08-ef09ba3bf84e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:55.316154 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d6f003-4956-48ec-8d08-ef09ba3bf84e None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:55.317099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6f003-4956-48ec-8d08-ef09ba3bf84e None admin] RBAC: Adding query filter params (name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:55.317603 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6f003-4956-48ec-8d08-ef09ba3bf84e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:55.319206 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d6f003-4956-48ec-8d08-ef09ba3bf84e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:55.328520 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 267/535] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jul 2 20:37:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:55.334309 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2cd1a-abb2-45f9-a9cd-9f0e3f8010bb None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:55.400693 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:55.444386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f2cd1a-abb2-45f9-a9cd-9f0e3f8010bb None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:55.478333 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddeabf1-a916-48eb-97b3-512f97530732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:55.479130 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddeabf1-a916-48eb-97b3-512f97530732 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:55.479412 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddeabf1-a916-48eb-97b3-512f97530732 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:55.479682 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddeabf1-a916-48eb-97b3-512f97530732 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:55.491777 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddeabf1-a916-48eb-97b3-512f97530732 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:55.493641 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddeabf1-a916-48eb-97b3-512f97530732 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:55.514040 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-eddeabf1-a916-48eb-97b3-512f97530732 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:55.514040 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:55.514040 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:55.514040 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:55.514040 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:55.514040 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:55.514040 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:55.514040 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:55.514040 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:55.514040 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:55.514040 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:55.514040 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:55.514040 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:37:55.514040 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:37:55.514040 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:37:55.515020 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:37:55.515020 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:55.515020 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:55.515020 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:55.515020 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:55.515020 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:55.515020 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:55.515020 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:55.515020 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:55.515020 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:55.515020 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:55.515020 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:55.515020 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:55.515020 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:55.515020 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:55.515020 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:55.515020 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:55.516111 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:37:55.516111 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:37:55.516111 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:55.516111 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:55.518507 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 269/536] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:55.524159 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6f003-4956-48ec-8d08-ef09ba3bf84e None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:55.630307 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d6f003-4956-48ec-8d08-ef09ba3bf84e None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:55.638198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:55.670894 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efc53e-1fb1-4f53-bec6-d7f0434c49d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:55.670894 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efc53e-1fb1-4f53-bec6-d7f0434c49d3 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:55.671779 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efc53e-1fb1-4f53-bec6-d7f0434c49d3 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:55.671986 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efc53e-1fb1-4f53-bec6-d7f0434c49d3 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:55.672733 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efc53e-1fb1-4f53-bec6-d7f0434c49d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:55.673040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efc53e-1fb1-4f53-bec6-d7f0434c49d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:55.674436 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efc53e-1fb1-4f53-bec6-d7f0434c49d3 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:55.687187 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 268/537] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:55.700177 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddeabf1-a916-48eb-97b3-512f97530732 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:55.742702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd4692-e641-433a-b163-aac7e4a3fe68 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:55.743025 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd4692-e641-433a-b163-aac7e4a3fe68 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:55.743215 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd4692-e641-433a-b163-aac7e4a3fe68 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:55.744708 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 269/538] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:37:55.752949 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f24d59-96fa-42ca-a4e9-bfa274119c10 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:55.753452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f24d59-96fa-42ca-a4e9-bfa274119c10 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:55.753967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f24d59-96fa-42ca-a4e9-bfa274119c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:55.771560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-08f24d59-96fa-42ca-a4e9-bfa274119c10 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:55.773725 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-08f24d59-96fa-42ca-a4e9-bfa274119c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:55.829589 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddeabf1-a916-48eb-97b3-512f97530732 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:55.847053 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:55.870930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 270/539] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:55.879750 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b804bc4-4b74-4a3c-9128-d1e56aad3bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:55.880596 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b804bc4-4b74-4a3c-9128-d1e56aad3bf9 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:55.880879 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b804bc4-4b74-4a3c-9128-d1e56aad3bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:55.881203 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b804bc4-4b74-4a3c-9128-d1e56aad3bf9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:55.889721 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b804bc4-4b74-4a3c-9128-d1e56aad3bf9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:55.891401 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b804bc4-4b74-4a3c-9128-d1e56aad3bf9 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:55.894736 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f24d59-96fa-42ca-a4e9-bfa274119c10 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:55.916812 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-4b804bc4-4b74-4a3c-9128-d1e56aad3bf9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:37:55.916812 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:55.916812 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:55.916812 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:55.916812 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:55.916812 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:55.916812 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:55.916812 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:55.916812 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:55.916812 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:55.916812 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:55.916812 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:55.916812 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:37:55.916812 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:37:55.916812 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:37:55.916812 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:37:55.917803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:55.917803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:55.917803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:37:55.917803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:37:55.917803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:37:55.917803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:37:55.917803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:55.917803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:55.917803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:55.917803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:55.917803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:55.917803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:55.917803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:55.917803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:55.917803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:55.917803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:55.917803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:55.917803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:55.918709 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:55.918709 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:55.918709 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:37:55.918709 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:37:55.918709 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:37:55.918709 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:37:55.918709 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:37:55.918709 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:37:55.918709 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:37:55.918709 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:55.921236 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 270/540] 10.222.0.57 () {56 vars in 1093 bytes} [Sat Jul 2 20:37:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:55.929752 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b804bc4-4b74-4a3c-9128-d1e56aad3bf9 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:56.006733 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:56.015041 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f24d59-96fa-42ca-a4e9-bfa274119c10 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:56.048949 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b804bc4-4b74-4a3c-9128-d1e56aad3bf9 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:56.051896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef2bec-5d65-42a5-887e-9c8852263c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:56.053005 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef2bec-5d65-42a5-887e-9c8852263c1a None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:56.053490 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef2bec-5d65-42a5-887e-9c8852263c1a None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:56.053993 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcef2bec-5d65-42a5-887e-9c8852263c1a None admin] PATH_INFO: `/v3/roles/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:56.066623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcef2bec-5d65-42a5-887e-9c8852263c1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:56.075573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-fcef2bec-5d65-42a5-887e-9c8852263c1a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:37:56.075573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:56.075573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:56.075573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:56.075573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:56.075573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:56.075573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:56.075573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:56.075573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:56.075573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:56.075573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:56.075573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:56.075573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:56.075573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:56.075573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:56.075573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:56.076553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:56.076553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:56.076553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:56.076553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:56.076553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:56.076553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:56.076553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:56.076553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:56.076553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:56.076553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:56.076553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:56.076553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:56.076553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:56.076553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:56.076553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:56.076553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:56.077353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:56.077353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:56.077353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:56.077353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:56.077353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:56.077353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:56.077353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:56.077353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:56.077353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:56.077353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:56.077353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:37:56.077353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:56.080736 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 271/541] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jul 2 20:37:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:37:56.086643 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef2bec-5d65-42a5-887e-9c8852263c1a None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:56.091851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80b766-1515-4c8c-8060-6e8db0df2ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:56.093469 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80b766-1515-4c8c-8060-6e8db0df2ad6 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:56.093469 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80b766-1515-4c8c-8060-6e8db0df2ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:56.093469 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80b766-1515-4c8c-8060-6e8db0df2ad6 None admin] PATH_INFO: `/v3/users` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:56.094640 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd80b766-1515-4c8c-8060-6e8db0df2ad6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:56.094992 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd80b766-1515-4c8c-8060-6e8db0df2ad6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:56.096517 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd80b766-1515-4c8c-8060-6e8db0df2ad6 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:56.121622 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 271/542] 10.222.0.57 () {56 vars in 1133 bytes} [Sat Jul 2 20:37:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:56.123210 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80b766-1515-4c8c-8060-6e8db0df2ad6 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:56.159090 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:56.226305 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcef2bec-5d65-42a5-887e-9c8852263c1a None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:56.254544 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80b766-1515-4c8c-8060-6e8db0df2ad6 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:56.269681 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb309e83-7125-4818-af7c-a05f3901fc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:56.270939 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb309e83-7125-4818-af7c-a05f3901fc5d None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:56.271446 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb309e83-7125-4818-af7c-a05f3901fc5d None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:56.272360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb309e83-7125-4818-af7c-a05f3901fc5d None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:56.273694 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb309e83-7125-4818-af7c-a05f3901fc5d None admin] RBAC: Adding query filter params (name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:56.274472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb309e83-7125-4818-af7c-a05f3901fc5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:56.276649 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb309e83-7125-4818-af7c-a05f3901fc5d None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:56.289191 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 272/543] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jul 2 20:37:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:56.299483 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb309e83-7125-4818-af7c-a05f3901fc5d None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:56.302450 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ec9cd1-5a64-4e46-9489-28ad8ddd374f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:56.303357 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec9cd1-5a64-4e46-9489-28ad8ddd374f None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:56.303640 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec9cd1-5a64-4e46-9489-28ad8ddd374f None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:56.303916 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ec9cd1-5a64-4e46-9489-28ad8ddd374f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:56.316039 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec9cd1-5a64-4e46-9489-28ad8ddd374f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:56.317585 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ec9cd1-5a64-4e46-9489-28ad8ddd374f None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:56.324794 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:56.337916 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-26ec9cd1-5a64-4e46-9489-28ad8ddd374f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:56.337916 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:56.337916 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:56.337916 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:56.337916 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:56.337916 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:56.337916 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:56.337916 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:56.337916 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:56.337916 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:56.337916 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:56.337916 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:56.337916 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:37:56.337916 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:37:56.337916 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:37:56.338796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:37:56.338796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:56.338796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:56.338796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:56.338796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:56.338796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:56.338796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:56.338796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:56.338796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:56.338796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:56.338796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:56.338796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:56.338796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:56.338796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:56.338796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:56.338796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:56.338796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:56.339850 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:37:56.339850 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:37:56.339850 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:56.339850 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:56.339850 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 272/544] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:56.340984 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27a049-e847-43d5-9f28-f8188f39794c None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:56.341274 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27a049-e847-43d5-9f28-f8188f39794c None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:56.341547 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27a049-e847-43d5-9f28-f8188f39794c None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:56.347333 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 273/545] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:56.347333 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27a049-e847-43d5-9f28-f8188f39794c None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:56.416505 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb309e83-7125-4818-af7c-a05f3901fc5d None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:56.428521 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:56.448288 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c27a049-e847-43d5-9f28-f8188f39794c None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:56.449948 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38ee27f-53e7-42bb-abf8-3b2f2560b1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:56.450803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ee27f-53e7-42bb-abf8-3b2f2560b1d3 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:56.451111 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ee27f-53e7-42bb-abf8-3b2f2560b1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:56.451389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38ee27f-53e7-42bb-abf8-3b2f2560b1d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:56.462539 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ee27f-53e7-42bb-abf8-3b2f2560b1d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:56.464095 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38ee27f-53e7-42bb-abf8-3b2f2560b1d3 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:56.481368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-c38ee27f-53e7-42bb-abf8-3b2f2560b1d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:56.481368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:56.481368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:56.481368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:56.481368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:56.481368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:56.481368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:56.481368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:56.481368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:56.481368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:56.481368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:56.481368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:56.481368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:37:56.481368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:37:56.481368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:37:56.482214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:37:56.482214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:56.482214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:56.482214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:56.482214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:56.482214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:56.482214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:56.482214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:56.482214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:56.482214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:56.482214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:56.482214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:56.482214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:56.482214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:56.482214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:56.482214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:56.482214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:56.483076 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:37:56.483076 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:37:56.483076 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:56.483076 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:56.483076 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 273/546] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:37:56.483775 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32ade6-5116-4f81-9ea9-50c36d81ada6 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:56.484052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32ade6-5116-4f81-9ea9-50c36d81ada6 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:56.484356 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32ade6-5116-4f81-9ea9-50c36d81ada6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:56.484765 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02c39e-c00a-4299-bd3e-d05e2b59104d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:56.485434 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02c39e-c00a-4299-bd3e-d05e2b59104d None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:56.485714 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02c39e-c00a-4299-bd3e-d05e2b59104d None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:56.485982 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02c39e-c00a-4299-bd3e-d05e2b59104d None admin] PATH_INFO: `/v3/domains` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:56.486713 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02c39e-c00a-4299-bd3e-d05e2b59104d None admin] RBAC: Adding query filter params (name=Default) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:56.487392 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02c39e-c00a-4299-bd3e-d05e2b59104d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:56.488523 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f02c39e-c00a-4299-bd3e-d05e2b59104d None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:56.500086 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 274/547] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:56.501411 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa9bd0-4106-4641-ad8c-2271e2ae5d69 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:56.501544 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-ce32ade6-5116-4f81-9ea9-50c36d81ada6 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:56.501705 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa9bd0-4106-4641-ad8c-2271e2ae5d69 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:56.501970 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa9bd0-4106-4641-ad8c-2271e2ae5d69 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:56.502590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-ce32ade6-5116-4f81-9ea9-50c36d81ada6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:56.503362 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 275/548] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:37:56.503960 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa9bd0-4106-4641-ad8c-2271e2ae5d69 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:56.569309 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:56.574261 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 274/549] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:56.575057 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32ade6-5116-4f81-9ea9-50c36d81ada6 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:56.619196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa9bd0-4106-4641-ad8c-2271e2ae5d69 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:56.651884 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cfa3ec-07d1-46d3-a092-79139957c074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:56.652541 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfa3ec-07d1-46d3-a092-79139957c074 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:56.652842 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfa3ec-07d1-46d3-a092-79139957c074 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:56.653111 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cfa3ec-07d1-46d3-a092-79139957c074 None admin] PATH_INFO: `/v3/domains` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:56.653826 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cfa3ec-07d1-46d3-a092-79139957c074 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:56.654129 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cfa3ec-07d1-46d3-a092-79139957c074 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:56.655557 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cfa3ec-07d1-46d3-a092-79139957c074 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:56.666489 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 276/550] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:56.667865 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235e773-dc36-4434-8802-81ff4c76b6f9 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:56.668151 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235e773-dc36-4434-8802-81ff4c76b6f9 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:56.668418 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5235e773-dc36-4434-8802-81ff4c76b6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:56.673304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:56.677950 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32ade6-5116-4f81-9ea9-50c36d81ada6 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:56.685785 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-5235e773-dc36-4434-8802-81ff4c76b6f9 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:56.686997 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-5235e773-dc36-4434-8802-81ff4c76b6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:56.716385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359dbbcc-1d23-4325-aa51-b9cec319723d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:56.717197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359dbbcc-1d23-4325-aa51-b9cec319723d None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:56.717474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359dbbcc-1d23-4325-aa51-b9cec319723d None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:56.717739 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359dbbcc-1d23-4325-aa51-b9cec319723d None admin] PATH_INFO: `/v3/projects/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:56.724682 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359dbbcc-1d23-4325-aa51-b9cec319723d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:56.726126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359dbbcc-1d23-4325-aa51-b9cec319723d None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:56.739890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-359dbbcc-1d23-4325-aa51-b9cec319723d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:37:56.739890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:56.739890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:56.739890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:56.739890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:56.739890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:56.739890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:56.739890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:56.739890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:56.739890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:56.739890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:56.739890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:56.739890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:37:56.739890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:37:56.739890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:37:56.740802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:37:56.740802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:56.740802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:56.740802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:56.740802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:56.740802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:56.740802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:56.740802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:56.740802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:56.740802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:56.740802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:56.740802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:56.740802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:56.740802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:56.740802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:56.740802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:56.740802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:56.741741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:37:56.741741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:37:56.741741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:37:56.741741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:37:56.741741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:37:56.741741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:37:56.741741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:37:56.741741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:56.741741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 275/551] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:37:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:56.742717 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359dbbcc-1d23-4325-aa51-b9cec319723d None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:56.758722 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 277/552] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:56.759442 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235e773-dc36-4434-8802-81ff4c76b6f9 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:56.803629 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:56.844045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359dbbcc-1d23-4325-aa51-b9cec319723d None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:56.866137 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5235e773-dc36-4434-8802-81ff4c76b6f9 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:56.876917 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872f93a-e707-460d-8e12-e152041b0cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:56.877714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872f93a-e707-460d-8e12-e152041b0cb0 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:56.877990 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872f93a-e707-460d-8e12-e152041b0cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:56.878256 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872f93a-e707-460d-8e12-e152041b0cb0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:56.888019 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872f93a-e707-460d-8e12-e152041b0cb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:56.895620 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:56.896060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-0872f93a-e707-460d-8e12-e152041b0cb0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:37:56.896060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:56.896060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:56.896060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:56.896060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:56.896060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:56.896060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:56.896060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:56.896060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:56.896060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:56.896060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:56.896060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:56.896060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:56.896060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:56.896060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:56.896060 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:56.897230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:56.897230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:56.897230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:56.897230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:56.897230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:56.897230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:56.897230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:56.897230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:56.897230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:56.897230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:56.897230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:56.897230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:56.897230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:56.897230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:56.897230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:56.897230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:56.898032 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:56.898032 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:56.898032 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:56.898032 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:56.898032 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:56.898032 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:56.898032 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:56.898032 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:56.898032 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:56.898032 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:56.898032 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:37:56.898032 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:56.898032 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 276/553] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jul 2 20:37:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:56.898032 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872f93a-e707-460d-8e12-e152041b0cb0 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:56.903995 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e21c97-ae57-43c3-acf7-c6e4ca240cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:56.905017 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e21c97-ae57-43c3-acf7-c6e4ca240cc7 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:56.905300 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e21c97-ae57-43c3-acf7-c6e4ca240cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:56.905571 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e21c97-ae57-43c3-acf7-c6e4ca240cc7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:56.913984 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e21c97-ae57-43c3-acf7-c6e4ca240cc7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:56.923542 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e21c97-ae57-43c3-acf7-c6e4ca240cc7 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:56.939048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-a0e21c97-ae57-43c3-acf7-c6e4ca240cc7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 02 20:37:56.939048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:56.939048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:56.939048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:56.939048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:56.939048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:56.939048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:56.939048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:56.939048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:56.939048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:56.939048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:56.939048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:56.939048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:37:56.939048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:37:56.939048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:37:56.939048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:37:56.940196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:56.940196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:56.940196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:37:56.940196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:37:56.940196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:37:56.940196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:37:56.940196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:56.940196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:56.940196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:56.940196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:56.940196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:56.940196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:56.940196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:56.940196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:56.940196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:56.940196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:56.940196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:56.940196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:56.941121 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:56.941121 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:56.941121 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:37:56.941121 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:37:56.941121 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:37:56.941121 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:37:56.941121 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:37:56.941121 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:37:56.941121 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 02 20:37:56.941121 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:56.941121 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 278/554] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:56.941121 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e21c97-ae57-43c3-acf7-c6e4ca240cc7 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:57.002498 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872f93a-e707-460d-8e12-e152041b0cb0 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:57.021765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:57.036346 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9cb05-1a0c-4f5e-b457-3263e660b89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:57.037107 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9cb05-1a0c-4f5e-b457-3263e660b89a None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:57.037451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9cb05-1a0c-4f5e-b457-3263e660b89a None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:57.037788 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9cb05-1a0c-4f5e-b457-3263e660b89a None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:57.038641 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9cb05-1a0c-4f5e-b457-3263e660b89a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:57.039077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9cb05-1a0c-4f5e-b457-3263e660b89a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:57.040520 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9cb05-1a0c-4f5e-b457-3263e660b89a None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:57.043357 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e21c97-ae57-43c3-acf7-c6e4ca240cc7 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:57.052714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 277/555] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jul 2 20:37:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:57.053413 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9cb05-1a0c-4f5e-b457-3263e660b89a None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:57.077962 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1dbce-e85d-432f-be5f-99f9311c36cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:57.078752 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1dbce-e85d-432f-be5f-99f9311c36cb None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:57.079062 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1dbce-e85d-432f-be5f-99f9311c36cb None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:57.079325 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1dbce-e85d-432f-be5f-99f9311c36cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:57.089373 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1dbce-e85d-432f-be5f-99f9311c36cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:37:57.097269 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-06a1dbce-e85d-432f-be5f-99f9311c36cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:37:57.097269 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:57.097269 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:57.097269 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:57.097269 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:57.097269 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:57.097269 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:57.097269 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:57.097269 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:57.097269 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:57.097269 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:57.097269 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:57.097269 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:37:57.097269 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:37:57.097269 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:37:57.097269 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:37:57.098163 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:37:57.098163 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:37:57.098163 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:37:57.098163 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:37:57.098163 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:57.098163 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:57.098163 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:57.098163 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:57.098163 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:57.098163 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:57.098163 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:57.098163 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:57.098163 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:57.098163 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:57.098163 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:57.098163 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:57.099002 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:57.099002 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:57.099002 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:57.099002 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:57.099002 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:37:57.099002 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:37:57.099002 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:37:57.099002 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:37:57.099002 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:37:57.099002 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:37:57.099002 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:37:57.099002 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:57.099002 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 279/556] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jul 2 20:37:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:57.099665 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1dbce-e85d-432f-be5f-99f9311c36cb None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:57.151109 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:57.159498 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9cb05-1a0c-4f5e-b457-3263e660b89a None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:57.193439 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea467d-aac5-46e4-85fa-0834eafbfccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:57.194112 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea467d-aac5-46e4-85fa-0834eafbfccd None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:57.194392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea467d-aac5-46e4-85fa-0834eafbfccd None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:57.194671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea467d-aac5-46e4-85fa-0834eafbfccd None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:57.195437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea467d-aac5-46e4-85fa-0834eafbfccd None admin] RBAC: Adding query filter params (name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:57.195743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea467d-aac5-46e4-85fa-0834eafbfccd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:57.197111 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea467d-aac5-46e4-85fa-0834eafbfccd None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:57.199393 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1dbce-e85d-432f-be5f-99f9311c36cb None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:57.205358 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 278/557] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jul 2 20:37:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:57.206119 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea467d-aac5-46e4-85fa-0834eafbfccd None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:57.234326 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f87e8-00b2-49a3-b8c4-851ab797563e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:57.235017 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f87e8-00b2-49a3-b8c4-851ab797563e None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:57.235298 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f87e8-00b2-49a3-b8c4-851ab797563e None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:57.235569 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540f87e8-00b2-49a3-b8c4-851ab797563e None admin] PATH_INFO: `/v3/users` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:57.236407 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f87e8-00b2-49a3-b8c4-851ab797563e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:57.236711 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f87e8-00b2-49a3-b8c4-851ab797563e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:57.238145 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540f87e8-00b2-49a3-b8c4-851ab797563e None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:57.251622 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:57.255134 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 280/558] 10.222.0.57 () {56 vars in 1137 bytes} [Sat Jul 2 20:37:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:57.256283 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f87e8-00b2-49a3-b8c4-851ab797563e None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:57.313002 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea467d-aac5-46e4-85fa-0834eafbfccd None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:57.346496 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85bf7d-64ba-4f8e-80a6-ced9658e5ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:57.347555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85bf7d-64ba-4f8e-80a6-ced9658e5ebd None admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:57.347785 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85bf7d-64ba-4f8e-80a6-ced9658e5ebd None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:57.348053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85bf7d-64ba-4f8e-80a6-ced9658e5ebd None admin] PATH_INFO: `/v3/projects/cd684ec63e1c4d61819302c837dd4349/users/eec825336f2e408ebabdcfd29845d5ad/roles/09c018c7ef5249efb8f68eb74acafe13` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:57.355309 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540f87e8-00b2-49a3-b8c4-851ab797563e None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:57.363892 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85bf7d-64ba-4f8e-80a6-ced9658e5ebd None admin] RBAC: Authorizing `identity:create_grant(project_id=cd684ec63e1c4d61819302c837dd4349, user_id=eec825336f2e408ebabdcfd29845d5ad, role_id=09c018c7ef5249efb8f68eb74acafe13)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:57.365352 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec85bf7d-64ba-4f8e-80a6-ced9658e5ebd None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:57.366442 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:57.379632 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 279/559] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jul 2 20:37:57 2022] PUT /identity/v3/projects/cd684ec63e1c4d61819302c837dd4349/users/eec825336f2e408ebabdcfd29845d5ad/roles/09c018c7ef5249efb8f68eb74acafe13 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:37:57.380432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85bf7d-64ba-4f8e-80a6-ced9658e5ebd None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:57.393011 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2ff69-5b2b-47d1-8a4e-db11f832f383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:57.393721 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2ff69-5b2b-47d1-8a4e-db11f832f383 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:57.394009 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2ff69-5b2b-47d1-8a4e-db11f832f383 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:57.394287 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2ff69-5b2b-47d1-8a4e-db11f832f383 None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:57.395121 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2ff69-5b2b-47d1-8a4e-db11f832f383 None admin] RBAC: Adding query filter params (name=service) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:57.395428 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2ff69-5b2b-47d1-8a4e-db11f832f383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:57.396923 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2ff69-5b2b-47d1-8a4e-db11f832f383 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:57.406301 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 281/560] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jul 2 20:37:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:57.407418 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2ff69-5b2b-47d1-8a4e-db11f832f383 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:57.493154 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:57.505384 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85bf7d-64ba-4f8e-80a6-ced9658e5ebd None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:57.519552 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2ff69-5b2b-47d1-8a4e-db11f832f383 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:57.542342 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbf5cd-83fe-4046-879a-158c5955ed2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:57.543164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbf5cd-83fe-4046-879a-158c5955ed2f None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:57.543449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbf5cd-83fe-4046-879a-158c5955ed2f None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:57.543715 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbf5cd-83fe-4046-879a-158c5955ed2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:57.554968 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbf5cd-83fe-4046-879a-158c5955ed2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:57.556453 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbf5cd-83fe-4046-879a-158c5955ed2f None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:57.559873 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148822d8-7412-46c3-8031-2018170e77c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:57.560873 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148822d8-7412-46c3-8031-2018170e77c8 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:57.561327 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148822d8-7412-46c3-8031-2018170e77c8 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:57.561757 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148822d8-7412-46c3-8031-2018170e77c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:57.574928 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148822d8-7412-46c3-8031-2018170e77c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:57.575298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-0bdbf5cd-83fe-4046-879a-158c5955ed2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:57.575298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:57.575298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:57.575298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:57.575298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:57.575298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:57.575298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:57.575298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:57.575298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:57.575298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:57.575298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:57.575298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:57.575298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:37:57.575298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:37:57.575298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:37:57.576322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:37:57.576322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:57.576322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:57.576322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:57.576322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:57.576322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:57.576322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:57.576322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:57.576322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:57.576322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:57.576322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:57.576322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:57.576322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:57.576322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:57.576322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:57.576322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:57.576322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:57.577786 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:37:57.577786 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:37:57.577786 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:57.577786 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:57.579720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148822d8-7412-46c3-8031-2018170e77c8 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:57.581466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 280/561] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:57.582313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbf5cd-83fe-4046-879a-158c5955ed2f None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:57.599391 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-148822d8-7412-46c3-8031-2018170e77c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:57.599391 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:57.599391 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:57.599391 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:57.599391 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:57.599391 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:57.599391 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:57.599391 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:57.599391 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:57.599391 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:57.599391 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:57.599391 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:57.599391 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:37:57.599391 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:37:57.599391 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:37:57.600459 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:37:57.600459 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:57.600459 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:57.600459 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:57.600459 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:57.600459 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:57.600459 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:57.600459 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:57.600459 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:57.600459 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:57.600459 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:57.600459 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:57.600459 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:57.600459 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:57.600459 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:57.600459 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:57.600459 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:57.601363 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:37:57.601363 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:37:57.601363 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:57.601363 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:57.601363 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 282/562] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:57.602057 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148822d8-7412-46c3-8031-2018170e77c8 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:57.628050 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:57.703225 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbf5cd-83fe-4046-879a-158c5955ed2f None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:57.712015 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148822d8-7412-46c3-8031-2018170e77c8 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:57.738795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d3e22-936a-4318-86f3-4a4103906eee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:57.739647 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d3e22-936a-4318-86f3-4a4103906eee None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:57.740110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d3e22-936a-4318-86f3-4a4103906eee None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:57.740349 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d3e22-936a-4318-86f3-4a4103906eee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:57.746784 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758a4c1-0ad3-4d74-9d6a-405272505859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:57.747604 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758a4c1-0ad3-4d74-9d6a-405272505859 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:57.747885 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758a4c1-0ad3-4d74-9d6a-405272505859 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:57.748157 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2758a4c1-0ad3-4d74-9d6a-405272505859 None admin] PATH_INFO: `/v3/domains` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:57.748877 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758a4c1-0ad3-4d74-9d6a-405272505859 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:57.749178 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758a4c1-0ad3-4d74-9d6a-405272505859 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:57.750781 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2758a4c1-0ad3-4d74-9d6a-405272505859 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:57.751762 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d3e22-936a-4318-86f3-4a4103906eee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:57.753215 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d3e22-936a-4318-86f3-4a4103906eee None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:57.756124 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:57.768175 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 283/563] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:57.768175 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758a4c1-0ad3-4d74-9d6a-405272505859 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:57.776823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-f38d3e22-936a-4318-86f3-4a4103906eee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:57.776823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:57.776823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:57.776823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:57.776823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:57.776823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:57.776823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:57.776823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:57.776823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:57.776823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:57.776823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:57.776823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:57.776823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:37:57.776823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:37:57.776823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:37:57.777686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:37:57.777686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:57.777686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:57.777686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:57.777686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:57.777686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:57.777686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:57.777686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:57.777686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:57.777686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:57.777686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:57.777686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:57.777686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:57.777686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:57.777686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:57.777686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:57.777686 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:57.778568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:37:57.778568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:37:57.778568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:57.778568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:57.778568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 281/564] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:57.779740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d3e22-936a-4318-86f3-4a4103906eee None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:57.861147 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:57.878786 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2758a4c1-0ad3-4d74-9d6a-405272505859 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:57.892906 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d3e22-936a-4318-86f3-4a4103906eee None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:57.918599 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d246cc8-c978-4134-8425-c43dc08aa8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:57.919299 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d246cc8-c978-4134-8425-c43dc08aa8d2 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:57.919575 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d246cc8-c978-4134-8425-c43dc08aa8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:57.919841 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d246cc8-c978-4134-8425-c43dc08aa8d2 None admin] PATH_INFO: `/v3/domains` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:57.920571 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d246cc8-c978-4134-8425-c43dc08aa8d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:57.920873 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d246cc8-c978-4134-8425-c43dc08aa8d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:57.922296 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d246cc8-c978-4134-8425-c43dc08aa8d2 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:57.928548 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77acbc-a0c7-4d08-9941-f0e6a845ab28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:57.929967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77acbc-a0c7-4d08-9941-f0e6a845ab28 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:57.930248 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77acbc-a0c7-4d08-9941-f0e6a845ab28 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:57.930517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77acbc-a0c7-4d08-9941-f0e6a845ab28 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:57.934018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 284/565] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:57.939355 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d246cc8-c978-4134-8425-c43dc08aa8d2 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:57.939611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77acbc-a0c7-4d08-9941-f0e6a845ab28 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:57.941201 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab77acbc-a0c7-4d08-9941-f0e6a845ab28 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:57.957355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-ab77acbc-a0c7-4d08-9941-f0e6a845ab28 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 02 20:37:57.957355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:57.957355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:57.957355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:57.957355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:57.957355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:57.957355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:57.957355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:57.957355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:57.957355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:57.957355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:57.957355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:57.957355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:37:57.957355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:37:57.957355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:37:57.957355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:37:57.958347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:57.958347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:57.958347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:37:57.958347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:37:57.958347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:37:57.958347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:37:57.958347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:57.958347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:57.958347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:57.958347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:57.958347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:57.958347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:57.958347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:57.958347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:57.958347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:57.958347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:57.958347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:57.958347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:57.959368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:57.959368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:57.959368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:37:57.959368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:37:57.959368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:37:57.959368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:37:57.959368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:37:57.959368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:37:57.959368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 02 20:37:57.959368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:57.959368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 282/566] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jul 2 20:37:57 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:57.959981 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77acbc-a0c7-4d08-9941-f0e6a845ab28 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:58.021798 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:58.053914 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d246cc8-c978-4134-8425-c43dc08aa8d2 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:58.072338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77acbc-a0c7-4d08-9941-f0e6a845ab28 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:58.090335 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0482e95-1975-4f0a-accf-0156bbc4231f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:58.091063 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0482e95-1975-4f0a-accf-0156bbc4231f None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:58.091320 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0482e95-1975-4f0a-accf-0156bbc4231f None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:58.091616 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0482e95-1975-4f0a-accf-0156bbc4231f None admin] PATH_INFO: `/v3/domains` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:58.092408 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0482e95-1975-4f0a-accf-0156bbc4231f None admin] RBAC: Adding query filter params (name=Default) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:58.092726 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0482e95-1975-4f0a-accf-0156bbc4231f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:58.094243 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0482e95-1975-4f0a-accf-0156bbc4231f None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:58.107042 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1043368-843b-4c36-b5c7-6e1019ccfff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:58.111899 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 285/567] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:58.112036 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1043368-843b-4c36-b5c7-6e1019ccfff0 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:58.112036 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1043368-843b-4c36-b5c7-6e1019ccfff0 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:58.112210 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0482e95-1975-4f0a-accf-0156bbc4231f None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:58.112306 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1043368-843b-4c36-b5c7-6e1019ccfff0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:58.115955 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:58.119709 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1043368-843b-4c36-b5c7-6e1019ccfff0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:58.121229 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1043368-843b-4c36-b5c7-6e1019ccfff0 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:58.136670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-c1043368-843b-4c36-b5c7-6e1019ccfff0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:37:58.136670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:58.136670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:58.136670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:58.136670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:58.136670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:58.136670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:58.136670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:58.136670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:58.136670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:58.136670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:58.136670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:58.136670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:37:58.136670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:37:58.136670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:37:58.137602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:37:58.137602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:58.137602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:58.137602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:58.137602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:58.137602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:58.137602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:58.137602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:58.137602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:58.137602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:58.137602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:58.137602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:58.137602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:58.137602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:58.137602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:58.137602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:58.137602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:58.138499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:37:58.138499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:37:58.138499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:37:58.138499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:37:58.138499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:37:58.138499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:37:58.138499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:37:58.138499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:58.138499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 283/568] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:37:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:58.139549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1043368-843b-4c36-b5c7-6e1019ccfff0 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:58.224607 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0482e95-1975-4f0a-accf-0156bbc4231f None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:58.239940 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1043368-843b-4c36-b5c7-6e1019ccfff0 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:58.256701 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:58.260114 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea18b5-677d-4a91-9c4c-5399ec3152f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:58.260802 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea18b5-677d-4a91-9c4c-5399ec3152f8 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:58.261081 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea18b5-677d-4a91-9c4c-5399ec3152f8 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:58.261346 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ea18b5-677d-4a91-9c4c-5399ec3152f8 None admin] PATH_INFO: `/v3/users` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:58.262196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea18b5-677d-4a91-9c4c-5399ec3152f8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:58.262502 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea18b5-677d-4a91-9c4c-5399ec3152f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:58.264077 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ea18b5-677d-4a91-9c4c-5399ec3152f8 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:58.275813 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33a2ae-769e-4457-a738-43019696d76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:58.276606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33a2ae-769e-4457-a738-43019696d76a None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:58.276883 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33a2ae-769e-4457-a738-43019696d76a None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:58.277152 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e33a2ae-769e-4457-a738-43019696d76a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:58.283196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 286/569] 10.222.0.57 () {56 vars in 1139 bytes} [Sat Jul 2 20:37:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:58.284515 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33a2ae-769e-4457-a738-43019696d76a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:58.285970 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e33a2ae-769e-4457-a738-43019696d76a None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:58.288710 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea18b5-677d-4a91-9c4c-5399ec3152f8 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:58.307794 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-3e33a2ae-769e-4457-a738-43019696d76a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 02 20:37:58.307794 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:58.307794 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:58.307794 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:58.307794 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:58.307794 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:58.307794 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:58.307794 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:58.307794 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:58.307794 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:58.307794 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:58.307794 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:58.307794 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:37:58.307794 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:37:58.307794 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:37:58.307794 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:37:58.308951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:58.308951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:58.308951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:37:58.308951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:37:58.308951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:37:58.308951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:37:58.308951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:58.308951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:58.308951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:58.308951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:58.308951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:58.308951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:58.308951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:58.308951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:58.308951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:58.308951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:58.308951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:58.308951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:58.309971 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:58.309971 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:58.309971 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:37:58.309971 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:37:58.309971 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:37:58.309971 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:37:58.309971 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:37:58.309971 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:37:58.309971 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 02 20:37:58.309971 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:58.312472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 284/570] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:37:58 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:58.313420 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33a2ae-769e-4457-a738-43019696d76a None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:58.361514 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:58.409900 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ea18b5-677d-4a91-9c4c-5399ec3152f8 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:58.422714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e33a2ae-769e-4457-a738-43019696d76a None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:58.445053 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8416c5-6cca-4c26-a493-c0ad0faa209e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:58.445719 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8416c5-6cca-4c26-a493-c0ad0faa209e None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:58.445990 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8416c5-6cca-4c26-a493-c0ad0faa209e None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:58.446257 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8416c5-6cca-4c26-a493-c0ad0faa209e None admin] PATH_INFO: `/v3/projects` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:58.447078 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8416c5-6cca-4c26-a493-c0ad0faa209e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:58.447386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8416c5-6cca-4c26-a493-c0ad0faa209e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:58.448815 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8416c5-6cca-4c26-a493-c0ad0faa209e None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:58.460497 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c57f9a-4643-4d4a-a60a-4c545354ea5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:58.466043 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 287/571] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jul 2 20:37:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:58.466194 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c57f9a-4643-4d4a-a60a-4c545354ea5d None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:58.466194 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c57f9a-4643-4d4a-a60a-4c545354ea5d None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:58.466194 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c57f9a-4643-4d4a-a60a-4c545354ea5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:58.466440 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8416c5-6cca-4c26-a493-c0ad0faa209e None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:58.478608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c57f9a-4643-4d4a-a60a-4c545354ea5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:58.480826 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c57f9a-4643-4d4a-a60a-4c545354ea5d None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:58.505239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-75c57f9a-4643-4d4a-a60a-4c545354ea5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:58.505239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:58.505239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:58.505239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:58.505239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:58.505239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:58.505239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:58.505239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:58.505239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:58.505239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:58.505239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:58.505239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:58.505239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:37:58.505239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:37:58.505239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:37:58.506155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:37:58.506155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:58.506155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:58.506155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:58.506155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:58.506155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:58.506155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:58.506155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:58.506155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:58.506155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:58.506155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:58.506155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:58.506155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:58.506155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:58.506155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:58.506155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:58.506155 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:58.507058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:37:58.507058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:37:58.507058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:58.507058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:58.507058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 285/572] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:58.512663 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c57f9a-4643-4d4a-a60a-4c545354ea5d None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:58.541610 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:58.580746 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8416c5-6cca-4c26-a493-c0ad0faa209e None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:58.605357 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:58.619187 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec2115-ea2b-4e2f-9f69-faa7ccd76113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:58.619858 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec2115-ea2b-4e2f-9f69-faa7ccd76113 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:58.620133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec2115-ea2b-4e2f-9f69-faa7ccd76113 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:58.620399 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec2115-ea2b-4e2f-9f69-faa7ccd76113 None admin] PATH_INFO: `/v3/users` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:58.621228 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec2115-ea2b-4e2f-9f69-faa7ccd76113 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:58.621580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec2115-ea2b-4e2f-9f69-faa7ccd76113 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:58.622765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c57f9a-4643-4d4a-a60a-4c545354ea5d None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:58.623084 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec2115-ea2b-4e2f-9f69-faa7ccd76113 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:58.647083 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 288/573] 10.222.0.57 () {56 vars in 1137 bytes} [Sat Jul 2 20:37:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:58.647083 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec2115-ea2b-4e2f-9f69-faa7ccd76113 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:58.660663 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491e39f-ec50-4acf-87af-fb1f50066d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:58.661498 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491e39f-ec50-4acf-87af-fb1f50066d18 None admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:58.661783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491e39f-ec50-4acf-87af-fb1f50066d18 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:58.662055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9491e39f-ec50-4acf-87af-fb1f50066d18 None admin] PATH_INFO: `/v3/projects/cd684ec63e1c4d61819302c837dd4349/users/bb3685e7474a40b0ba9115283446d430/roles/09c018c7ef5249efb8f68eb74acafe13` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:58.677626 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491e39f-ec50-4acf-87af-fb1f50066d18 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd684ec63e1c4d61819302c837dd4349, user_id=bb3685e7474a40b0ba9115283446d430, role_id=09c018c7ef5249efb8f68eb74acafe13)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:58.679111 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9491e39f-ec50-4acf-87af-fb1f50066d18 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:58.695812 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 286/574] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jul 2 20:37:58 2022] PUT /identity/v3/projects/cd684ec63e1c4d61819302c837dd4349/users/bb3685e7474a40b0ba9115283446d430/roles/09c018c7ef5249efb8f68eb74acafe13 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:37:58.708027 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491e39f-ec50-4acf-87af-fb1f50066d18 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:58.790721 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec2115-ea2b-4e2f-9f69-faa7ccd76113 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:58.829912 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8bec5-d7a1-4524-84e0-3403d99125db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:58.830593 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8bec5-d7a1-4524-84e0-3403d99125db None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:58.830871 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8bec5-d7a1-4524-84e0-3403d99125db None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:58.831168 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a8bec5-d7a1-4524-84e0-3403d99125db None admin] PATH_INFO: `/v3/domains` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:58.831889 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8bec5-d7a1-4524-84e0-3403d99125db None admin] RBAC: Adding query filter params (name=Default) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:58.832194 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8bec5-d7a1-4524-84e0-3403d99125db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:58.833578 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a8bec5-d7a1-4524-84e0-3403d99125db None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:58.840071 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:58.852364 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 289/575] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:58.853825 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8bec5-d7a1-4524-84e0-3403d99125db None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:58.873590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9491e39f-ec50-4acf-87af-fb1f50066d18 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:58.901847 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:58.928447 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9ce0d-3674-4ed5-bc8f-ccabd6cbd2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:58.929171 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9ce0d-3674-4ed5-bc8f-ccabd6cbd2a7 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:58.929412 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9ce0d-3674-4ed5-bc8f-ccabd6cbd2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:58.929680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9ce0d-3674-4ed5-bc8f-ccabd6cbd2a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:58.948437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9ce0d-3674-4ed5-bc8f-ccabd6cbd2a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:58.950272 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd9ce0d-3674-4ed5-bc8f-ccabd6cbd2a7 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:58.973066 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a8bec5-d7a1-4524-84e0-3403d99125db None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:58.974866 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-1bd9ce0d-3674-4ed5-bc8f-ccabd6cbd2a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:58.974866 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:58.974866 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:58.974866 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:58.974866 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:58.974866 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:58.974866 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:58.974866 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:58.974866 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:58.974866 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:58.974866 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:58.974866 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:58.974866 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:37:58.974866 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:37:58.974866 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:37:58.975741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:37:58.975741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:58.975741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:58.975741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:58.975741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:58.975741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:58.975741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:58.975741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:58.975741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:58.975741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:58.975741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:58.975741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:58.975741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:58.975741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:58.975741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:58.975741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:58.975741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:58.976613 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:37:58.976613 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:37:58.976613 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:37:58.976613 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:58.977405 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 287/576] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:58.983952 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9ce0d-3674-4ed5-bc8f-ccabd6cbd2a7 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:59.011575 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5c505-d19d-4a5b-9138-31bd0564128a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:59.012397 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5c505-d19d-4a5b-9138-31bd0564128a None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:59.012670 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5c505-d19d-4a5b-9138-31bd0564128a None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:59.012944 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5c505-d19d-4a5b-9138-31bd0564128a None admin] PATH_INFO: `/v3/projects/service` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:59.020280 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5c505-d19d-4a5b-9138-31bd0564128a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:59.021745 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5c505-d19d-4a5b-9138-31bd0564128a None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:59.037168 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-1cc5c505-d19d-4a5b-9138-31bd0564128a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:37:59.037168 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:59.037168 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:59.037168 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:59.037168 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:59.037168 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:59.037168 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:59.037168 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:59.037168 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:59.037168 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:59.037168 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:59.037168 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:59.037168 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:37:59.037168 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:37:59.037168 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:37:59.038100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:37:59.038100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:59.038100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:59.038100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:59.038100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:59.038100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:59.038100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:59.038100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:59.038100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:59.038100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:59.038100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:59.038100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:59.038100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:59.038100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:59.038100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:59.038100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:59.038100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:59.039021 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:37:59.039021 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:37:59.039021 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:37:59.039021 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:37:59.039021 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:37:59.039021 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:37:59.039021 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:37:59.039021 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:37:59.043130 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 290/577] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:37:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:59.044485 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5c505-d19d-4a5b-9138-31bd0564128a None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:59.111226 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd9ce0d-3674-4ed5-bc8f-ccabd6cbd2a7 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:59.154000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:59.157576 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:59.161674 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5c505-d19d-4a5b-9138-31bd0564128a None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:59.163487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebceb2-8ba0-4c44-b60e-1c25b6c15fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:59.165248 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebceb2-8ba0-4c44-b60e-1c25b6c15fef None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:59.166767 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebceb2-8ba0-4c44-b60e-1c25b6c15fef None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:59.167245 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cebceb2-8ba0-4c44-b60e-1c25b6c15fef None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:59.168156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebceb2-8ba0-4c44-b60e-1c25b6c15fef None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:59.168665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebceb2-8ba0-4c44-b60e-1c25b6c15fef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:59.170236 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cebceb2-8ba0-4c44-b60e-1c25b6c15fef None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:59.187932 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 288/578] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:59.188916 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebceb2-8ba0-4c44-b60e-1c25b6c15fef None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:59.213113 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414768a4-f49b-4a81-aa1a-77888f374523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:59.214531 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414768a4-f49b-4a81-aa1a-77888f374523 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:59.215046 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414768a4-f49b-4a81-aa1a-77888f374523 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:59.215786 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414768a4-f49b-4a81-aa1a-77888f374523 None admin] PATH_INFO: `/v3/projects` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:59.217436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414768a4-f49b-4a81-aa1a-77888f374523 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:59.217941 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414768a4-f49b-4a81-aa1a-77888f374523 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:59.220853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414768a4-f49b-4a81-aa1a-77888f374523 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:59.240547 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 291/579] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jul 2 20:37:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:59.241910 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414768a4-f49b-4a81-aa1a-77888f374523 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:59.314669 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cebceb2-8ba0-4c44-b60e-1c25b6c15fef None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:59.361274 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069afdac-a87d-45f7-aa78-4cf4d6a4d009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:59.361524 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414768a4-f49b-4a81-aa1a-77888f374523 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:59.362537 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069afdac-a87d-45f7-aa78-4cf4d6a4d009 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:59.363277 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069afdac-a87d-45f7-aa78-4cf4d6a4d009 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:59.363732 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069afdac-a87d-45f7-aa78-4cf4d6a4d009 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:59.373439 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069afdac-a87d-45f7-aa78-4cf4d6a4d009 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:59.375737 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069afdac-a87d-45f7-aa78-4cf4d6a4d009 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:59.396989 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284c4bf-b9e9-4134-bb30-80f6329a6a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:59.397985 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284c4bf-b9e9-4134-bb30-80f6329a6a07 None admin] REQUEST_METHOD: `PUT` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:59.398333 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284c4bf-b9e9-4134-bb30-80f6329a6a07 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:59.398710 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3284c4bf-b9e9-4134-bb30-80f6329a6a07 None admin] PATH_INFO: `/v3/projects/cd684ec63e1c4d61819302c837dd4349/users/bfcc022be567428db48e7b2a71d9c069/roles/09c018c7ef5249efb8f68eb74acafe13` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:59.400220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-069afdac-a87d-45f7-aa78-4cf4d6a4d009 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:37:59.400220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:37:59.400220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:37:59.400220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:37:59.400220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:37:59.400220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:37:59.400220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:37:59.400220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:37:59.400220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:37:59.400220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:37:59.400220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:37:59.400220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:37:59.400220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:37:59.400220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:37:59.400220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:37:59.401164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:37:59.401164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:37:59.401164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:37:59.401164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:37:59.401164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:37:59.401164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:37:59.401164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:37:59.401164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:37:59.401164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:37:59.401164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:37:59.401164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:37:59.401164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:37:59.401164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:37:59.401164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:37:59.401164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:37:59.401164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:37:59.401164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:37:59.402056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:37:59.402056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:37:59.402056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:37:59.402056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:37:59.402056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:37:59.402056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:37:59.402056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:37:59.402056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:37:59.410470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 289/580] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:37:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:37:59.411919 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069afdac-a87d-45f7-aa78-4cf4d6a4d009 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:59.417592 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284c4bf-b9e9-4134-bb30-80f6329a6a07 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd684ec63e1c4d61819302c837dd4349, user_id=bfcc022be567428db48e7b2a71d9c069, role_id=09c018c7ef5249efb8f68eb74acafe13)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:59.419084 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3284c4bf-b9e9-4134-bb30-80f6329a6a07 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:59.443870 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 292/581] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jul 2 20:37:59 2022] PUT /identity/v3/projects/cd684ec63e1c4d61819302c837dd4349/users/bfcc022be567428db48e7b2a71d9c069/roles/09c018c7ef5249efb8f68eb74acafe13 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 20:37:59.491931 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:59.550746 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069afdac-a87d-45f7-aa78-4cf4d6a4d009 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:59.589597 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cce72d-eae7-4a8b-a16b-11c7311e374e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:59.590537 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cce72d-eae7-4a8b-a16b-11c7311e374e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:59.591050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cce72d-eae7-4a8b-a16b-11c7311e374e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:59.591502 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cce72d-eae7-4a8b-a16b-11c7311e374e None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:59.592455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cce72d-eae7-4a8b-a16b-11c7311e374e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:37:59.592923 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cce72d-eae7-4a8b-a16b-11c7311e374e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:59.594768 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cce72d-eae7-4a8b-a16b-11c7311e374e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:59.608603 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 290/582] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jul 2 20:37:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:37:59.617151 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284c4bf-b9e9-4134-bb30-80f6329a6a07 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:59.631688 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:59.704875 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c946417-d8b5-43ac-b7cf-8f5b7e8381e1 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:59.705378 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c946417-d8b5-43ac-b7cf-8f5b7e8381e1 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:59.705815 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c946417-d8b5-43ac-b7cf-8f5b7e8381e1 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:59.707666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 291/583] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:37:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:37:59.716608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995823c-8bf3-4c1d-a8f6-cb803c71bda2 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:59.716884 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995823c-8bf3-4c1d-a8f6-cb803c71bda2 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:59.717262 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995823c-8bf3-4c1d-a8f6-cb803c71bda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:59.743245 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3284c4bf-b9e9-4134-bb30-80f6329a6a07 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:37:59.745736 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-0995823c-8bf3-4c1d-a8f6-cb803c71bda2 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:37:59.747067 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-0995823c-8bf3-4c1d-a8f6-cb803c71bda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:37:59.790610 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb90029-6072-4df7-8069-9c34394de76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:37:59.792479 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb90029-6072-4df7-8069-9c34394de76c None admin] REQUEST_METHOD: `PUT` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:37:59.792931 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb90029-6072-4df7-8069-9c34394de76c None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:37:59.793372 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb90029-6072-4df7-8069-9c34394de76c None admin] PATH_INFO: `/v3/projects/cd684ec63e1c4d61819302c837dd4349/users/875c7134ed804201831348457be9d247/roles/09c018c7ef5249efb8f68eb74acafe13` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:37:59.810865 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb90029-6072-4df7-8069-9c34394de76c None admin] RBAC: Authorizing `identity:create_grant(project_id=cd684ec63e1c4d61819302c837dd4349, user_id=875c7134ed804201831348457be9d247, role_id=09c018c7ef5249efb8f68eb74acafe13)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:37:59.812713 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb90029-6072-4df7-8069-9c34394de76c None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:37:59.822702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 292/584] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:37:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:37:59.828844 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 293/585] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jul 2 20:37:59 2022] PUT /identity/v3/projects/cd684ec63e1c4d61819302c837dd4349/users/875c7134ed804201831348457be9d247/roles/09c018c7ef5249efb8f68eb74acafe13 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:37:59.849285 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb90029-6072-4df7-8069-9c34394de76c None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:37:59.927617 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:37:59.967738 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb90029-6072-4df7-8069-9c34394de76c None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:00.006161 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bec3e-63ea-4e50-8eb1-bc8037887c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:00.007743 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bec3e-63ea-4e50-8eb1-bc8037887c89 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:00.008199 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bec3e-63ea-4e50-8eb1-bc8037887c89 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:00.008621 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bec3e-63ea-4e50-8eb1-bc8037887c89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:00.021216 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bec3e-63ea-4e50-8eb1-bc8037887c89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:38:00.029471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-439bec3e-63ea-4e50-8eb1-bc8037887c89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:38:00.029471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:00.029471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:00.029471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:00.029471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:00.029471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:00.029471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:00.029471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:00.029471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:00.029471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:00.029471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:00.029471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:00.029471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:38:00.029471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:38:00.029471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:38:00.029471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:38:00.030675 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:38:00.030675 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:38:00.030675 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:38:00.030675 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:38:00.030675 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:00.030675 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:00.030675 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:00.030675 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:00.030675 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:00.030675 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:00.030675 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:00.030675 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:00.030675 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:00.030675 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:00.030675 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:00.030675 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:00.031657 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:00.031657 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:00.031657 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:00.031657 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:00.031657 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:38:00.031657 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:38:00.031657 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:38:00.031657 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:38:00.031657 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:38:00.031657 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:38:00.031657 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:38:00.031657 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:00.033320 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 294/586] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jul 2 20:37:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:00.039553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995823c-8bf3-4c1d-a8f6-cb803c71bda2 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:00.090212 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:00.148182 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995823c-8bf3-4c1d-a8f6-cb803c71bda2 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:00.182460 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5fd3c6-d1c1-457e-8c89-b926567f94f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:00.183177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fd3c6-d1c1-457e-8c89-b926567f94f9 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:00.183457 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fd3c6-d1c1-457e-8c89-b926567f94f9 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:00.183726 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5fd3c6-d1c1-457e-8c89-b926567f94f9 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:00.184465 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5fd3c6-d1c1-457e-8c89-b926567f94f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:00.184764 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5fd3c6-d1c1-457e-8c89-b926567f94f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:00.186142 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5fd3c6-d1c1-457e-8c89-b926567f94f9 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:00.195053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 293/587] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jul 2 20:38:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:00.204332 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bec3e-63ea-4e50-8eb1-bc8037887c89 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:00.309601 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bec3e-63ea-4e50-8eb1-bc8037887c89 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:00.331203 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:00.355557 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d174d7-76e4-4d37-bbfe-111882edbd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:00.356357 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d174d7-76e4-4d37-bbfe-111882edbd55 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:00.356631 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d174d7-76e4-4d37-bbfe-111882edbd55 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:00.356898 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d174d7-76e4-4d37-bbfe-111882edbd55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:00.368205 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d174d7-76e4-4d37-bbfe-111882edbd55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:00.369648 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d174d7-76e4-4d37-bbfe-111882edbd55 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:00.387079 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-c0d174d7-76e4-4d37-bbfe-111882edbd55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:00.387079 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:00.387079 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:00.387079 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:00.387079 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:00.387079 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:00.387079 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:00.387079 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:00.387079 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:00.387079 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:00.387079 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:00.387079 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:00.387079 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:38:00.387079 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:38:00.387079 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:38:00.388014 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:38:00.388014 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:00.388014 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:00.388014 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:00.388014 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:00.388014 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:00.388014 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:00.388014 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:00.388014 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:00.388014 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:00.388014 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:00.388014 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:00.388014 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:00.388014 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:00.388014 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:00.388014 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:00.388014 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:00.388905 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:38:00.388905 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:38:00.388905 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:00.388905 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:00.388905 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 295/588] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:38:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:00.395410 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5fd3c6-d1c1-457e-8c89-b926567f94f9 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:00.498114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5fd3c6-d1c1-457e-8c89-b926567f94f9 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:00.500322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:00.534145 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d452e03-6a88-4d9f-99fc-ba95dbca93ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:00.534819 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d452e03-6a88-4d9f-99fc-ba95dbca93ee None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:00.535134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d452e03-6a88-4d9f-99fc-ba95dbca93ee None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:00.535409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d452e03-6a88-4d9f-99fc-ba95dbca93ee None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:00.536138 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d452e03-6a88-4d9f-99fc-ba95dbca93ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:00.536445 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d452e03-6a88-4d9f-99fc-ba95dbca93ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:00.537834 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d452e03-6a88-4d9f-99fc-ba95dbca93ee None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:00.549912 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 294/589] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:00.555472 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d174d7-76e4-4d37-bbfe-111882edbd55 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:00.660822 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d174d7-76e4-4d37-bbfe-111882edbd55 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:00.697826 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d2074-a1f1-4131-86e4-e4fa6df5eff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:00.698642 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d2074-a1f1-4131-86e4-e4fa6df5eff7 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:00.698935 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d2074-a1f1-4131-86e4-e4fa6df5eff7 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:00.699229 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d2074-a1f1-4131-86e4-e4fa6df5eff7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:00.708136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d2074-a1f1-4131-86e4-e4fa6df5eff7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:00.709610 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d2074-a1f1-4131-86e4-e4fa6df5eff7 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:00.724989 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-2d9d2074-a1f1-4131-86e4-e4fa6df5eff7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:38:00.724989 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:00.724989 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:00.724989 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:00.724989 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:00.724989 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:00.724989 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:00.724989 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:00.724989 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:00.724989 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:00.724989 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:00.724989 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:00.724989 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:38:00.724989 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:38:00.724989 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:38:00.724989 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:38:00.725929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:00.725929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:00.725929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:38:00.725929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:38:00.725929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:38:00.725929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:38:00.725929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:00.725929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:00.725929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:00.725929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:00.725929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:00.725929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:00.725929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:00.725929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:00.725929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:00.725929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:00.725929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:00.725929 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:00.727312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:00.727312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:00.727312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:38:00.727312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:38:00.727312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:38:00.727312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:38:00.727312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:38:00.727312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:38:00.727312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:38:00.727312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:00.727312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 296/590] 10.222.0.57 () {56 vars in 1093 bytes} [Sat Jul 2 20:38:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:00.732227 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d452e03-6a88-4d9f-99fc-ba95dbca93ee None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:00.833954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d452e03-6a88-4d9f-99fc-ba95dbca93ee None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:00.868919 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2519fd-019c-4409-a41f-b89814a2551d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:00.869627 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2519fd-019c-4409-a41f-b89814a2551d None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:00.869909 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2519fd-019c-4409-a41f-b89814a2551d None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:00.870184 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2519fd-019c-4409-a41f-b89814a2551d None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:00.871097 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2519fd-019c-4409-a41f-b89814a2551d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:00.871412 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2519fd-019c-4409-a41f-b89814a2551d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:00.872968 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2519fd-019c-4409-a41f-b89814a2551d None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:00.898245 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 295/591] 10.222.0.57 () {56 vars in 1133 bytes} [Sat Jul 2 20:38:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:00.903581 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d2074-a1f1-4131-86e4-e4fa6df5eff7 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:00.936510 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:01.007721 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d2074-a1f1-4131-86e4-e4fa6df5eff7 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:01.042482 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76e047-abe5-49a7-9c77-44752d0d1b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:01.043188 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76e047-abe5-49a7-9c77-44752d0d1b3c None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:01.043470 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76e047-abe5-49a7-9c77-44752d0d1b3c None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:01.043747 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76e047-abe5-49a7-9c77-44752d0d1b3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:01.103698 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313efe6d-8ef5-4692-976d-ce8af786689a None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:01.104227 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313efe6d-8ef5-4692-976d-ce8af786689a None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:01.104227 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313efe6d-8ef5-4692-976d-ce8af786689a None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:01.105961 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 296/592] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:01.111869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07437e7-caa8-458e-90d2-83ec988c2f27 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:01.112198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07437e7-caa8-458e-90d2-83ec988c2f27 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:01.112424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07437e7-caa8-458e-90d2-83ec988c2f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:01.120487 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76e047-abe5-49a7-9c77-44752d0d1b3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:01.121989 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76e047-abe5-49a7-9c77-44752d0d1b3c None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:01.138027 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-e07437e7-caa8-458e-90d2-83ec988c2f27 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:01.140350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-e07437e7-caa8-458e-90d2-83ec988c2f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:01.156448 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:01.158010 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:01.219510 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 297/593] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:38:01.247238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07437e7-caa8-458e-90d2-83ec988c2f27 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:01.247794 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 297/594] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:38:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:38:01.253487 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76e047-abe5-49a7-9c77-44752d0d1b3c None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:01.353800 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07437e7-caa8-458e-90d2-83ec988c2f27 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:01.367133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76e047-abe5-49a7-9c77-44752d0d1b3c None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:01.399839 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:01.407298 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d7312-0f86-4b7f-af41-d47a9763207c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:01.408106 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d7312-0f86-4b7f-af41-d47a9763207c None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:01.408385 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d7312-0f86-4b7f-af41-d47a9763207c None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:01.408656 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d7312-0f86-4b7f-af41-d47a9763207c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:01.409802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e82b9-92eb-4a55-968a-749ae20fff02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:01.410604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e82b9-92eb-4a55-968a-749ae20fff02 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:01.410878 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e82b9-92eb-4a55-968a-749ae20fff02 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:01.411169 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076e82b9-92eb-4a55-968a-749ae20fff02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:01.424401 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076e82b9-92eb-4a55-968a-749ae20fff02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:38:01.424561 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d7312-0f86-4b7f-af41-d47a9763207c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:01.425926 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d7312-0f86-4b7f-af41-d47a9763207c None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:01.433598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-076e82b9-92eb-4a55-968a-749ae20fff02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:38:01.433598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:01.433598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:01.433598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:01.433598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:01.433598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:01.433598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:01.433598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:01.433598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:01.433598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:01.433598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:01.433598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:01.433598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:38:01.433598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:38:01.433598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:38:01.433598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:38:01.434534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:38:01.434534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:38:01.434534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:38:01.434534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:38:01.434534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:01.434534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:01.434534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:01.434534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:01.434534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:01.434534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:01.434534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:01.434534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:01.434534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:01.434534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:01.434534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:01.434534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:01.435399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:01.435399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:01.435399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:01.435399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:01.435399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:38:01.435399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:38:01.435399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:38:01.435399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:38:01.435399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:38:01.435399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:38:01.435399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:38:01.435399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:01.438377 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 298/595] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jul 2 20:38:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:38:01.444494 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e82b9-92eb-4a55-968a-749ae20fff02 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:01.449994 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-d73d7312-0f86-4b7f-af41-d47a9763207c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:01.449994 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:01.449994 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:01.449994 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:01.449994 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:01.449994 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:01.449994 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:01.449994 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:01.449994 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:01.449994 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:01.449994 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:01.449994 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:01.449994 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:38:01.449994 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:38:01.449994 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:38:01.450861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:38:01.450861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:01.450861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:01.450861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:01.450861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:01.450861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:01.450861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:01.450861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:01.450861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:01.450861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:01.450861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:01.450861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:01.450861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:01.450861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:01.450861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:01.450861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:01.450861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:01.451802 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:38:01.451802 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:38:01.451802 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:01.451802 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:01.456272 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 298/596] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:01.457121 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d7312-0f86-4b7f-af41-d47a9763207c None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:01.462595 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:01.561507 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076e82b9-92eb-4a55-968a-749ae20fff02 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:01.582162 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d7312-0f86-4b7f-af41-d47a9763207c None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:01.600179 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8861338-5ca7-40e0-afdf-94ceb5f01ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:01.601228 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8861338-5ca7-40e0-afdf-94ceb5f01ecd None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:01.601802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8861338-5ca7-40e0-afdf-94ceb5f01ecd None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:01.602338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8861338-5ca7-40e0-afdf-94ceb5f01ecd None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:01.603453 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8861338-5ca7-40e0-afdf-94ceb5f01ecd None admin] RBAC: Adding query filter params (name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:01.603992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8861338-5ca7-40e0-afdf-94ceb5f01ecd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:01.605757 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8861338-5ca7-40e0-afdf-94ceb5f01ecd None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:01.616009 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 299/597] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jul 2 20:38:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:38:01.621343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8861338-5ca7-40e0-afdf-94ceb5f01ecd None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:01.635347 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9a613-97b5-4b9c-afad-06a94cae7166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:01.636491 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9a613-97b5-4b9c-afad-06a94cae7166 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:01.637562 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9a613-97b5-4b9c-afad-06a94cae7166 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:01.638048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9a613-97b5-4b9c-afad-06a94cae7166 None admin] PATH_INFO: `/v3/domains` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:01.639659 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9a613-97b5-4b9c-afad-06a94cae7166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:01.640737 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9a613-97b5-4b9c-afad-06a94cae7166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:01.643383 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb9a613-97b5-4b9c-afad-06a94cae7166 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:01.666549 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 299/598] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:38:01.668678 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9a613-97b5-4b9c-afad-06a94cae7166 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:01.709326 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:01.732048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:01.753757 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8861338-5ca7-40e0-afdf-94ceb5f01ecd None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:01.790305 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28646857-8957-4df5-b3f5-22962cd4cdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:01.791205 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28646857-8957-4df5-b3f5-22962cd4cdf1 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:01.791489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28646857-8957-4df5-b3f5-22962cd4cdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:01.791765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28646857-8957-4df5-b3f5-22962cd4cdf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:01.803664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28646857-8957-4df5-b3f5-22962cd4cdf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:01.805143 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28646857-8957-4df5-b3f5-22962cd4cdf1 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:01.807825 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb9a613-97b5-4b9c-afad-06a94cae7166 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:01.826198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-28646857-8957-4df5-b3f5-22962cd4cdf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:01.826198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:01.826198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:01.826198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:01.826198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:01.826198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:01.826198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:01.826198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:01.826198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:01.826198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:01.826198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:01.826198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:01.826198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:38:01.826198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:38:01.826198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:38:01.827144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:38:01.827144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:01.827144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:01.827144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:01.827144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:01.827144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:01.827144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:01.827144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:01.827144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:01.827144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:01.827144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:01.827144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:01.827144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:01.827144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:01.827144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:01.827144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:01.827144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:01.828413 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:38:01.828413 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:38:01.828413 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:01.828413 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:01.831359 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 300/599] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:01.833684 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28646857-8957-4df5-b3f5-22962cd4cdf1 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:01.857968 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910bab9-8c79-4efb-92b4-8cb16ec5db0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:01.859577 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910bab9-8c79-4efb-92b4-8cb16ec5db0c None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:01.860427 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910bab9-8c79-4efb-92b4-8cb16ec5db0c None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:01.860930 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910bab9-8c79-4efb-92b4-8cb16ec5db0c None admin] PATH_INFO: `/v3/projects/service` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:01.868760 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910bab9-8c79-4efb-92b4-8cb16ec5db0c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:01.870236 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910bab9-8c79-4efb-92b4-8cb16ec5db0c None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:01.884196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-b910bab9-8c79-4efb-92b4-8cb16ec5db0c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:38:01.884196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:01.884196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:01.884196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:01.884196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:01.884196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:01.884196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:01.884196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:01.884196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:01.884196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:01.884196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:01.884196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:01.884196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:38:01.884196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:38:01.884196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:38:01.885136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:38:01.885136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:01.885136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:01.885136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:01.885136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:01.885136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:01.885136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:01.885136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:01.885136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:01.885136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:01.885136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:01.885136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:01.885136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:01.885136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:01.885136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:01.885136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:01.885136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:01.886084 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:38:01.886084 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:38:01.886084 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:38:01.886084 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:38:01.886084 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:38:01.886084 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:38:01.886084 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:38:01.886084 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:01.886084 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 300/600] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:38:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:01.886928 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c03e94-831b-4e85-974a-5212cccf21fc None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:01.886928 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c03e94-831b-4e85-974a-5212cccf21fc None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:01.887167 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c03e94-831b-4e85-974a-5212cccf21fc None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:01.888583 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 301/601] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:01.894429 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c03e94-831b-4e85-974a-5212cccf21fc None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:01.947479 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28646857-8957-4df5-b3f5-22962cd4cdf1 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:01.974147 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:01.987173 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8958ca0-f3a7-4a7d-90f3-66f2534bccd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:01.988145 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8958ca0-f3a7-4a7d-90f3-66f2534bccd1 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:01.988574 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8958ca0-f3a7-4a7d-90f3-66f2534bccd1 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:01.988995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8958ca0-f3a7-4a7d-90f3-66f2534bccd1 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:01.989971 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8958ca0-f3a7-4a7d-90f3-66f2534bccd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:01.990572 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8958ca0-f3a7-4a7d-90f3-66f2534bccd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:01.992064 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8958ca0-f3a7-4a7d-90f3-66f2534bccd1 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:01.996924 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c03e94-831b-4e85-974a-5212cccf21fc None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:01.999231 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:02.010450 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 301/602] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:02.011926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129edb2-73b4-47d4-b12b-b7d65287fe4e None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:02.012223 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129edb2-73b4-47d4-b12b-b7d65287fe4e None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:02.012503 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0129edb2-73b4-47d4-b12b-b7d65287fe4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:02.030674 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-0129edb2-73b4-47d4-b12b-b7d65287fe4e None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:02.031816 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e77307-70aa-4e95-86de-9a688df7af39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:02.032451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-0129edb2-73b4-47d4-b12b-b7d65287fe4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:02.032618 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e77307-70aa-4e95-86de-9a688df7af39 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:02.032871 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e77307-70aa-4e95-86de-9a688df7af39 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:02.033145 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e77307-70aa-4e95-86de-9a688df7af39 None admin] PATH_INFO: `/v3/projects` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:02.033949 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e77307-70aa-4e95-86de-9a688df7af39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:02.034254 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e77307-70aa-4e95-86de-9a688df7af39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:02.035740 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e77307-70aa-4e95-86de-9a688df7af39 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:02.052753 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 302/603] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jul 2 20:38:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:38:02.053623 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e77307-70aa-4e95-86de-9a688df7af39 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:02.115886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 302/604] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:38:02.116657 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129edb2-73b4-47d4-b12b-b7d65287fe4e None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:02.180390 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e77307-70aa-4e95-86de-9a688df7af39 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:02.216943 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01743ef-a203-4200-beb0-645e492e5be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:02.217745 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01743ef-a203-4200-beb0-645e492e5be6 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:02.218023 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01743ef-a203-4200-beb0-645e492e5be6 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:02.218294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01743ef-a203-4200-beb0-645e492e5be6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:02.225815 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01743ef-a203-4200-beb0-645e492e5be6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:02.227295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01743ef-a203-4200-beb0-645e492e5be6 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:02.228357 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0129edb2-73b4-47d4-b12b-b7d65287fe4e None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:02.242116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-c01743ef-a203-4200-beb0-645e492e5be6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 02 20:38:02.242116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:02.242116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:02.242116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:02.242116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:02.242116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:02.242116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:02.242116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:02.242116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:02.242116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:02.242116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:02.242116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:02.242116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:38:02.242116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:38:02.242116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:38:02.242116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:38:02.243292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:02.243292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:02.243292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:38:02.243292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:38:02.243292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:38:02.243292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:38:02.243292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:02.243292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:02.243292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:02.243292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:02.243292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:02.243292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:02.243292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:02.243292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:02.243292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:02.243292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:02.243292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:02.243292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:02.244250 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:02.244250 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:02.244250 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:38:02.244250 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:38:02.244250 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:38:02.244250 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:38:02.244250 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:38:02.244250 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:38:02.244250 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 02 20:38:02.244250 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:02.244250 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 303/605] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:38:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:02.244829 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01743ef-a203-4200-beb0-645e492e5be6 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:02.246643 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:02.269852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bb8d7-0a05-454d-ae90-c995a54be52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:02.270436 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bb8d7-0a05-454d-ae90-c995a54be52b None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:02.270715 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bb8d7-0a05-454d-ae90-c995a54be52b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:02.271014 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6bb8d7-0a05-454d-ae90-c995a54be52b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:02.271869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bb8d7-0a05-454d-ae90-c995a54be52b None admin] RBAC: Adding query filter params (role.id=09c018c7ef5249efb8f68eb74acafe13, scope.project.id=cd684ec63e1c4d61819302c837dd4349, user.id=eec825336f2e408ebabdcfd29845d5ad) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:02.272179 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bb8d7-0a05-454d-ae90-c995a54be52b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:02.273641 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6bb8d7-0a05-454d-ae90-c995a54be52b None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:02.274178 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:02.280489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 303/606] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:38:02 2022] GET /identity/v3/role_assignments?user.id=eec825336f2e408ebabdcfd29845d5ad&scope.project.id=cd684ec63e1c4d61819302c837dd4349&role.id=09c018c7ef5249efb8f68eb74acafe13 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:02.281332 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bb8d7-0a05-454d-ae90-c995a54be52b None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:02.378872 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01743ef-a203-4200-beb0-645e492e5be6 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:02.399917 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6bb8d7-0a05-454d-ae90-c995a54be52b None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:02.418284 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350d5f0-86c6-4d42-8e47-a7e15e41585d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:02.419144 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350d5f0-86c6-4d42-8e47-a7e15e41585d None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:02.419430 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350d5f0-86c6-4d42-8e47-a7e15e41585d None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:02.419696 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350d5f0-86c6-4d42-8e47-a7e15e41585d None admin] PATH_INFO: `/v3/roles/service` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:02.434006 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3350d5f0-86c6-4d42-8e47-a7e15e41585d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:38:02.438599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b47bbbf-8b43-4525-83b3-3a2cc24d17a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:02.439348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47bbbf-8b43-4525-83b3-3a2cc24d17a1 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:02.439770 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47bbbf-8b43-4525-83b3-3a2cc24d17a1 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:02.440037 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b47bbbf-8b43-4525-83b3-3a2cc24d17a1 None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:02.440887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47bbbf-8b43-4525-83b3-3a2cc24d17a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:02.441202 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47bbbf-8b43-4525-83b3-3a2cc24d17a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:02.442441 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-3350d5f0-86c6-4d42-8e47-a7e15e41585d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:38:02.442441 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:02.442441 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:02.442441 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:02.442441 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:02.442441 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:02.442441 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:02.442441 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:02.442441 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:02.442441 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:02.442441 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:02.442441 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:02.442441 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:38:02.442441 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:38:02.442441 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:38:02.442441 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:38:02.443401 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:38:02.443401 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:38:02.443401 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:38:02.443401 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:38:02.443401 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:02.443401 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:02.443401 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:02.443401 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:02.443401 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:02.443401 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:02.443401 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:02.443401 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:02.443401 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:02.443401 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:02.443401 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:02.443401 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:02.444644 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:02.444644 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:02.444644 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:02.444644 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:02.444644 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:38:02.444644 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:38:02.444644 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:38:02.444644 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:38:02.444644 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:38:02.444644 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:38:02.444644 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:38:02.444644 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:02.445493 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b47bbbf-8b43-4525-83b3-3a2cc24d17a1 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:02.445568 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 304/607] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jul 2 20:38:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:02.445568 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149597f-3f67-4d95-bc36-9afc38c1062b None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:02.445713 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149597f-3f67-4d95-bc36-9afc38c1062b None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:02.445972 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149597f-3f67-4d95-bc36-9afc38c1062b None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:02.447558 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 305/608] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:02.452223 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149597f-3f67-4d95-bc36-9afc38c1062b None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:02.470032 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 304/609] 10.222.0.57 () {56 vars in 1137 bytes} [Sat Jul 2 20:38:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:02.471807 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbcc4b-ffad-4786-8436-af12ef55297a None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:02.472192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbcc4b-ffad-4786-8436-af12ef55297a None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:02.472559 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbcc4b-ffad-4786-8436-af12ef55297a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:02.492842 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-6ddbcc4b-ffad-4786-8436-af12ef55297a None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:02.494189 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-6ddbcc4b-ffad-4786-8436-af12ef55297a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:02.529126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:02.558552 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:02.572764 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 305/610] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:38:02.573761 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddbcc4b-ffad-4786-8436-af12ef55297a None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:02.586108 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1149597f-3f67-4d95-bc36-9afc38c1062b None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:02.622436 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1c3b2-5fea-4c6a-a0d9-21050089f232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:02.623337 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1c3b2-5fea-4c6a-a0d9-21050089f232 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:02.623657 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1c3b2-5fea-4c6a-a0d9-21050089f232 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:02.624022 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1c3b2-5fea-4c6a-a0d9-21050089f232 None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:02.624975 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1c3b2-5fea-4c6a-a0d9-21050089f232 None admin] RBAC: Adding query filter params (name=service) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:02.625371 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1c3b2-5fea-4c6a-a0d9-21050089f232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:02.626962 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b1c3b2-5fea-4c6a-a0d9-21050089f232 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:02.635509 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 306/611] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jul 2 20:38:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:02.636357 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1c3b2-5fea-4c6a-a0d9-21050089f232 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:02.684916 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddbcc4b-ffad-4786-8436-af12ef55297a None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:02.728693 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4ab52-c1cc-4bc0-b7d1-d8236bd640b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:02.729354 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4ab52-c1cc-4bc0-b7d1-d8236bd640b9 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:02.729634 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4ab52-c1cc-4bc0-b7d1-d8236bd640b9 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:02.729905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc4ab52-c1cc-4bc0-b7d1-d8236bd640b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:02.757398 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1c3b2-5fea-4c6a-a0d9-21050089f232 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:02.764519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:02.800368 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513eeac-fd67-43ed-905e-d38d4cb756ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:02.800582 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4ab52-c1cc-4bc0-b7d1-d8236bd640b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:02.801225 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513eeac-fd67-43ed-905e-d38d4cb756ee None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:02.801551 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513eeac-fd67-43ed-905e-d38d4cb756ee None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:02.801826 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513eeac-fd67-43ed-905e-d38d4cb756ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:02.802371 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc4ab52-c1cc-4bc0-b7d1-d8236bd640b9 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:02.815129 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513eeac-fd67-43ed-905e-d38d4cb756ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:38:02.825065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-7513eeac-fd67-43ed-905e-d38d4cb756ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:38:02.825065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:02.825065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:02.825065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:02.825065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:02.825065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:02.825065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:02.825065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:02.825065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:02.825065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:02.825065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:02.825065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:02.825065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:38:02.825065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:38:02.825065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:38:02.825065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:38:02.826259 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:38:02.826259 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:38:02.826259 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:38:02.826259 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:38:02.826259 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:02.826259 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:02.826259 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:02.826259 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:02.826259 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:02.826259 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:02.826259 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:02.826259 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:02.826259 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:02.826259 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:02.826259 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:02.826259 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:02.827323 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:02.827323 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:02.827323 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:02.827323 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:02.827323 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:38:02.827323 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:38:02.827323 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:38:02.827323 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:38:02.827323 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:38:02.827323 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:38:02.827323 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:38:02.827323 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:02.829367 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 307/612] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jul 2 20:38:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:02.830230 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513eeac-fd67-43ed-905e-d38d4cb756ee None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:02.840754 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:02.913067 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 306/613] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:38:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:38:02.913858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4ab52-c1cc-4bc0-b7d1-d8236bd640b9 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:02.946633 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513eeac-fd67-43ed-905e-d38d4cb756ee None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:02.984408 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f94e42-98ed-4c8d-b36e-2d2a9d0ae1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:02.985695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f94e42-98ed-4c8d-b36e-2d2a9d0ae1a7 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:02.985977 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f94e42-98ed-4c8d-b36e-2d2a9d0ae1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:02.986350 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f94e42-98ed-4c8d-b36e-2d2a9d0ae1a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:02.986855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:02.997562 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f94e42-98ed-4c8d-b36e-2d2a9d0ae1a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:02.999062 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f94e42-98ed-4c8d-b36e-2d2a9d0ae1a7 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:03.018067 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-96f94e42-98ed-4c8d-b36e-2d2a9d0ae1a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:03.018067 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:03.018067 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:03.018067 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:03.018067 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:03.018067 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:03.018067 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:03.018067 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:03.018067 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:03.018067 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:03.018067 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:03.018067 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:03.018067 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:38:03.018067 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:38:03.018067 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:38:03.019034 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:38:03.019034 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:03.019034 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:03.019034 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:03.019034 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:03.019034 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:03.019034 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:03.019034 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:03.019034 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:03.019034 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:03.019034 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:03.019034 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:03.019034 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:03.019034 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:03.019034 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:03.019034 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:03.019034 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:03.019893 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:38:03.019893 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:38:03.019893 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:03.019893 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:03.023992 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 308/614] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:38:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:03.024580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f94e42-98ed-4c8d-b36e-2d2a9d0ae1a7 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:03.026300 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc4ab52-c1cc-4bc0-b7d1-d8236bd640b9 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:03.062899 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d1353-7ac1-4fae-987b-9fb51fa76c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:03.063609 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d1353-7ac1-4fae-987b-9fb51fa76c8c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:03.063893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d1353-7ac1-4fae-987b-9fb51fa76c8c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:03.064167 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731d1353-7ac1-4fae-987b-9fb51fa76c8c None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:03.064903 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d1353-7ac1-4fae-987b-9fb51fa76c8c None admin] RBAC: Adding query filter params (name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:03.065207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d1353-7ac1-4fae-987b-9fb51fa76c8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:03.066583 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731d1353-7ac1-4fae-987b-9fb51fa76c8c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:03.075382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 307/615] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jul 2 20:38:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:03.076201 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d1353-7ac1-4fae-987b-9fb51fa76c8c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:03.095509 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:03.143824 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f94e42-98ed-4c8d-b36e-2d2a9d0ae1a7 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:03.177300 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31da0c1-6b7b-4aff-a573-414d2e329aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:03.178021 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31da0c1-6b7b-4aff-a573-414d2e329aa8 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:03.178300 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31da0c1-6b7b-4aff-a573-414d2e329aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:03.178573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31da0c1-6b7b-4aff-a573-414d2e329aa8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:03.189204 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31da0c1-6b7b-4aff-a573-414d2e329aa8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:03.190675 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31da0c1-6b7b-4aff-a573-414d2e329aa8 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:03.195087 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731d1353-7ac1-4fae-987b-9fb51fa76c8c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:03.209125 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-e31da0c1-6b7b-4aff-a573-414d2e329aa8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:03.209125 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:03.209125 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:03.209125 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:03.209125 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:03.209125 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:03.209125 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:03.209125 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:03.209125 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:03.209125 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:03.209125 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:03.209125 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:03.209125 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:38:03.209125 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:38:03.209125 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:38:03.210018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:38:03.210018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:03.210018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:03.210018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:03.210018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:03.210018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:03.210018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:03.210018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:03.210018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:03.210018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:03.210018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:03.210018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:03.210018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:03.210018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:03.210018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:03.210018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:03.210018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:03.210934 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:38:03.210934 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:38:03.210934 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:03.210934 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:03.211889 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 309/616] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:03.212682 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31da0c1-6b7b-4aff-a573-414d2e329aa8 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:03.228918 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:03.238259 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70a781-289c-4ab8-8063-b1afcd0f5d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:03.238963 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70a781-289c-4ab8-8063-b1afcd0f5d61 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:03.239452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70a781-289c-4ab8-8063-b1afcd0f5d61 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:03.239673 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c70a781-289c-4ab8-8063-b1afcd0f5d61 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:03.240392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70a781-289c-4ab8-8063-b1afcd0f5d61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:03.240707 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70a781-289c-4ab8-8063-b1afcd0f5d61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:03.242110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c70a781-289c-4ab8-8063-b1afcd0f5d61 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:03.255245 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 308/617] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:03.256141 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70a781-289c-4ab8-8063-b1afcd0f5d61 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:03.327123 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31da0c1-6b7b-4aff-a573-414d2e329aa8 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:03.339319 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:03.360938 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c70a781-289c-4ab8-8063-b1afcd0f5d61 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:03.365637 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d3d36-578c-49ab-aaca-41d8bc997d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:03.366635 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d3d36-578c-49ab-aaca-41d8bc997d3b None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:03.366755 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d3d36-578c-49ab-aaca-41d8bc997d3b None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:03.367053 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d3d36-578c-49ab-aaca-41d8bc997d3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:03.382444 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d3d36-578c-49ab-aaca-41d8bc997d3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:03.383836 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d3d36-578c-49ab-aaca-41d8bc997d3b None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:03.397152 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26da228-5928-4faa-a76b-157e0443a1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:03.397938 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26da228-5928-4faa-a76b-157e0443a1f0 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:03.398306 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26da228-5928-4faa-a76b-157e0443a1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:03.398669 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26da228-5928-4faa-a76b-157e0443a1f0 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:03.399517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26da228-5928-4faa-a76b-157e0443a1f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:03.399935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26da228-5928-4faa-a76b-157e0443a1f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:03.401380 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26da228-5928-4faa-a76b-157e0443a1f0 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:03.401471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-fd3d3d36-578c-49ab-aaca-41d8bc997d3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:03.401471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:03.401471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:03.401471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:03.401471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:03.401471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:03.401471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:03.401471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:03.401471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:03.401471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:03.401471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:03.401471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:03.401471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:38:03.401471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:38:03.401471 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:38:03.402437 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:38:03.402437 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:03.402437 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:03.402437 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:03.402437 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:03.402437 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:03.402437 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:03.402437 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:03.402437 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:03.402437 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:03.402437 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:03.402437 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:03.402437 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:03.402437 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:03.402437 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:03.402437 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:03.402437 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:03.403553 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:38:03.403553 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:38:03.403553 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:03.403553 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:03.407408 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 310/618] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:03.408268 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d3d36-578c-49ab-aaca-41d8bc997d3b None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:03.421239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 309/619] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:03.421239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26da228-5928-4faa-a76b-157e0443a1f0 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:03.472948 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:03.513058 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d3d36-578c-49ab-aaca-41d8bc997d3b None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:03.537169 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26da228-5928-4faa-a76b-157e0443a1f0 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:03.547508 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae5d12-9d66-47df-af6d-ac85123c6baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:03.548325 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae5d12-9d66-47df-af6d-ac85123c6baf None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:03.548908 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae5d12-9d66-47df-af6d-ac85123c6baf None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:03.548908 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdae5d12-9d66-47df-af6d-ac85123c6baf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:03.557045 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae5d12-9d66-47df-af6d-ac85123c6baf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:03.558583 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdae5d12-9d66-47df-af6d-ac85123c6baf None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:03.573867 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-cdae5d12-9d66-47df-af6d-ac85123c6baf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 02 20:38:03.573867 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:03.573867 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:03.573867 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:03.573867 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:03.573867 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:03.573867 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:03.573867 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:03.573867 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:03.573867 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:03.573867 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:03.573867 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:03.573867 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:38:03.573867 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:38:03.573867 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:38:03.573867 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:38:03.574835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:03.574835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:03.574835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:38:03.574835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:38:03.574835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:38:03.574835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:38:03.574835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:03.574835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:03.574835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:03.574835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:03.574835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:03.574835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:03.574835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:03.574835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:03.574835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:03.574835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:03.574835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:03.574835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:03.575865 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:03.575865 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:03.575865 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:38:03.575865 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:38:03.575865 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:38:03.575865 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:38:03.575865 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:38:03.575865 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:38:03.575865 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 02 20:38:03.575865 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:03.576384 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efd4fd-d637-4f16-be61-d33ca30f383b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:03.576384 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efd4fd-d637-4f16-be61-d33ca30f383b None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:03.576384 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efd4fd-d637-4f16-be61-d33ca30f383b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:03.576384 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6efd4fd-d637-4f16-be61-d33ca30f383b None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:03.576647 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6efd4fd-d637-4f16-be61-d33ca30f383b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:03.576647 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6efd4fd-d637-4f16-be61-d33ca30f383b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:03.578324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6efd4fd-d637-4f16-be61-d33ca30f383b None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:03.580250 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 311/620] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jul 2 20:38:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:03.580988 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae5d12-9d66-47df-af6d-ac85123c6baf None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:03.591374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 310/621] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:03.592062 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efd4fd-d637-4f16-be61-d33ca30f383b None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:03.612293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:03.698096 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdae5d12-9d66-47df-af6d-ac85123c6baf None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:03.706804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6efd4fd-d637-4f16-be61-d33ca30f383b None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:03.717485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:03.732674 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c4e49-5a83-4749-aa40-a9e7d9398f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:03.733460 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c4e49-5a83-4749-aa40-a9e7d9398f40 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:03.733690 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c4e49-5a83-4749-aa40-a9e7d9398f40 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:03.734008 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c4e49-5a83-4749-aa40-a9e7d9398f40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:03.741271 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c4e49-5a83-4749-aa40-a9e7d9398f40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:03.742917 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04c4e49-5a83-4749-aa40-a9e7d9398f40 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:03.747589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1371d-ad32-40c4-8e79-6fcb9ce44a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:03.748359 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1371d-ad32-40c4-8e79-6fcb9ce44a0e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:03.748745 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1371d-ad32-40c4-8e79-6fcb9ce44a0e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:03.749216 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1371d-ad32-40c4-8e79-6fcb9ce44a0e None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:03.750202 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1371d-ad32-40c4-8e79-6fcb9ce44a0e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:03.750638 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1371d-ad32-40c4-8e79-6fcb9ce44a0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:03.752247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1371d-ad32-40c4-8e79-6fcb9ce44a0e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:03.760338 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-e04c4e49-5a83-4749-aa40-a9e7d9398f40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:38:03.760338 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:03.760338 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:03.760338 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:03.760338 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:03.760338 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:03.760338 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:03.760338 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:03.760338 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:03.760338 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:03.760338 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:03.760338 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:03.760338 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:38:03.760338 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:38:03.760338 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:38:03.761396 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:38:03.761396 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:03.761396 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:03.761396 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:03.761396 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:03.761396 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:03.761396 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:03.761396 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:03.761396 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:03.761396 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:03.761396 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:03.761396 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:03.761396 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:03.761396 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:03.761396 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:03.761396 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:03.761396 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:03.768019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:38:03.768019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:38:03.768019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:38:03.768019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:38:03.768019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:38:03.768019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:38:03.768019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:38:03.768019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:03.768019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 312/622] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:38:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:03.768019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c4e49-5a83-4749-aa40-a9e7d9398f40 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:03.784759 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 311/623] 10.222.0.57 () {56 vars in 1139 bytes} [Sat Jul 2 20:38:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:03.784759 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1371d-ad32-40c4-8e79-6fcb9ce44a0e None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:03.860230 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:03.878839 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c4e49-5a83-4749-aa40-a9e7d9398f40 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:03.888994 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1371d-ad32-40c4-8e79-6fcb9ce44a0e None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:03.917285 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7e14c-6288-4c08-a12f-7270f493eca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:03.918266 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7e14c-6288-4c08-a12f-7270f493eca8 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:03.918615 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7e14c-6288-4c08-a12f-7270f493eca8 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:03.918983 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7e14c-6288-4c08-a12f-7270f493eca8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:03.925329 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01554c-d362-413b-acf0-965b4d8543d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:03.926077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01554c-d362-413b-acf0-965b4d8543d7 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:03.926428 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01554c-d362-413b-acf0-965b4d8543d7 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:03.926771 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e01554c-d362-413b-acf0-965b4d8543d7 None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:03.927408 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7e14c-6288-4c08-a12f-7270f493eca8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:03.927724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01554c-d362-413b-acf0-965b4d8543d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:03.928095 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01554c-d362-413b-acf0-965b4d8543d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:03.929057 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7e14c-6288-4c08-a12f-7270f493eca8 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:03.929695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e01554c-d362-413b-acf0-965b4d8543d7 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:03.946377 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 312/624] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jul 2 20:38:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:03.946377 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01554c-d362-413b-acf0-965b4d8543d7 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:03.946772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-ecf7e14c-6288-4c08-a12f-7270f493eca8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 02 20:38:03.946772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:03.946772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:03.946772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:03.946772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:03.946772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:03.946772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:03.946772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:03.946772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:03.946772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:03.946772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:03.946772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:03.946772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:38:03.946772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:38:03.946772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:38:03.946772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:38:03.948303 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:03.948303 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:03.948303 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:38:03.948303 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:38:03.948303 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:38:03.948303 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:38:03.948303 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:03.948303 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:03.948303 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:03.948303 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:03.948303 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:03.948303 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:03.948303 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:03.948303 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:03.948303 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:03.948303 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:03.948303 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:03.948303 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:03.949451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:03.949451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:03.949451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:38:03.949451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:38:03.949451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:38:03.949451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:38:03.949451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:38:03.949451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:38:03.949451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 02 20:38:03.949451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:03.949451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 313/625] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:38:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:03.950818 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7e14c-6288-4c08-a12f-7270f493eca8 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:03.978013 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:04.057951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e01554c-d362-413b-acf0-965b4d8543d7 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:04.060847 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7e14c-6288-4c08-a12f-7270f493eca8 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:04.094075 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fb4bd-4bbc-42cb-8137-28a8c23cd987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:04.094733 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fb4bd-4bbc-42cb-8137-28a8c23cd987 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:04.095053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fb4bd-4bbc-42cb-8137-28a8c23cd987 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:04.095326 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fb4bd-4bbc-42cb-8137-28a8c23cd987 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:04.101466 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082cf7d-83ee-42aa-8d69-f67725f6e42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:04.102743 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082cf7d-83ee-42aa-8d69-f67725f6e42f None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:04.103248 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082cf7d-83ee-42aa-8d69-f67725f6e42f None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:04.103715 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082cf7d-83ee-42aa-8d69-f67725f6e42f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:04.104730 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082cf7d-83ee-42aa-8d69-f67725f6e42f None admin] RBAC: Adding query filter params (role.id=09c018c7ef5249efb8f68eb74acafe13, scope.project.id=cd684ec63e1c4d61819302c837dd4349, user.id=bb3685e7474a40b0ba9115283446d430) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:04.105233 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082cf7d-83ee-42aa-8d69-f67725f6e42f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:04.106873 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082cf7d-83ee-42aa-8d69-f67725f6e42f None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:04.113945 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 314/626] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:38:03 2022] GET /identity/v3/role_assignments?user.id=bb3685e7474a40b0ba9115283446d430&scope.project.id=cd684ec63e1c4d61819302c837dd4349&role.id=09c018c7ef5249efb8f68eb74acafe13 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:04.115010 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082cf7d-83ee-42aa-8d69-f67725f6e42f None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:04.133502 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:04.187822 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fb4bd-4bbc-42cb-8137-28a8c23cd987 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:04.190232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05fb4bd-4bbc-42cb-8137-28a8c23cd987 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:04.233591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:04.254775 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082cf7d-83ee-42aa-8d69-f67725f6e42f None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:04.295193 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c067698-fe29-4039-b04a-10375732c382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:04.296260 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c067698-fe29-4039-b04a-10375732c382 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:04.296921 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c067698-fe29-4039-b04a-10375732c382 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:04.297439 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c067698-fe29-4039-b04a-10375732c382 None admin] PATH_INFO: `/v3/users` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:04.298598 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c067698-fe29-4039-b04a-10375732c382 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:04.299178 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c067698-fe29-4039-b04a-10375732c382 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:04.300869 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c067698-fe29-4039-b04a-10375732c382 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:04.327221 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 315/627] 10.222.0.57 () {56 vars in 1137 bytes} [Sat Jul 2 20:38:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:04.333096 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c067698-fe29-4039-b04a-10375732c382 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:04.344357 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 313/628] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:38:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:38:04.349579 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fb4bd-4bbc-42cb-8137-28a8c23cd987 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:04.437839 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:04.484774 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05fb4bd-4bbc-42cb-8137-28a8c23cd987 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:04.509891 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c067698-fe29-4039-b04a-10375732c382 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:04.514932 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:04.525785 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b82bd-dbde-4c1a-af94-648d2b781db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:04.526555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b82bd-dbde-4c1a-af94-648d2b781db1 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:04.526968 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b82bd-dbde-4c1a-af94-648d2b781db1 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:04.527340 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b82bd-dbde-4c1a-af94-648d2b781db1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:04.539715 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b82bd-dbde-4c1a-af94-648d2b781db1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:04.541970 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b82bd-dbde-4c1a-af94-648d2b781db1 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:04.554067 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a893f1c-0010-4458-9d71-e8d6ff0aadc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:04.554848 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a893f1c-0010-4458-9d71-e8d6ff0aadc5 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:04.555269 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a893f1c-0010-4458-9d71-e8d6ff0aadc5 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:04.555637 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a893f1c-0010-4458-9d71-e8d6ff0aadc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:04.565555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-344b82bd-dbde-4c1a-af94-648d2b781db1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:04.565555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:04.565555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:04.565555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:04.565555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:04.565555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:04.565555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:04.565555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:04.565555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:04.565555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:04.565555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:04.565555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:04.565555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:38:04.565555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:38:04.565555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:38:04.566658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:38:04.566658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:04.566658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:04.566658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:04.566658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:04.566658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:04.566658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:04.566658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:04.566658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:04.566658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:04.566658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:04.566658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:04.566658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:04.566658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:04.566658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:04.566658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:04.566658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:04.567850 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:38:04.567850 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:38:04.567850 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:04.567850 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:04.574619 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 314/629] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:38:04.575666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b82bd-dbde-4c1a-af94-648d2b781db1 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:04.645576 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a893f1c-0010-4458-9d71-e8d6ff0aadc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:04.647562 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a893f1c-0010-4458-9d71-e8d6ff0aadc5 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:04.700143 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b82bd-dbde-4c1a-af94-648d2b781db1 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:04.724787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:04.735732 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5374a6da-86f5-444d-b2fd-849d6b633ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:04.736405 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374a6da-86f5-444d-b2fd-849d6b633ef0 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:04.736687 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374a6da-86f5-444d-b2fd-849d6b633ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:04.736963 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374a6da-86f5-444d-b2fd-849d6b633ef0 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:04.737680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374a6da-86f5-444d-b2fd-849d6b633ef0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:04.737983 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374a6da-86f5-444d-b2fd-849d6b633ef0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:04.739392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5374a6da-86f5-444d-b2fd-849d6b633ef0 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:04.756856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 315/630] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:04.756856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c59a34-1b15-44ec-85cf-2ffa4ca248f9 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:04.756856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c59a34-1b15-44ec-85cf-2ffa4ca248f9 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:04.756856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c59a34-1b15-44ec-85cf-2ffa4ca248f9 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:04.756856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 316/631] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:04.761281 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0771ab-774c-4b3e-91dd-80db801b5901 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:04.761575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0771ab-774c-4b3e-91dd-80db801b5901 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:04.761854 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0771ab-774c-4b3e-91dd-80db801b5901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:04.775435 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 316/632] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:38:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:38:04.775435 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a893f1c-0010-4458-9d71-e8d6ff0aadc5 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:04.784042 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-db0771ab-774c-4b3e-91dd-80db801b5901 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:04.785255 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-db0771ab-774c-4b3e-91dd-80db801b5901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:04.817224 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:04.862963 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 317/633] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:38:04.862963 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0771ab-774c-4b3e-91dd-80db801b5901 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:04.900143 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a893f1c-0010-4458-9d71-e8d6ff0aadc5 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:04.934002 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34085952-ea4f-4b27-956b-93bda81b8888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:04.934804 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34085952-ea4f-4b27-956b-93bda81b8888 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:04.935119 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34085952-ea4f-4b27-956b-93bda81b8888 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:04.935420 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34085952-ea4f-4b27-956b-93bda81b8888 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:04.942876 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34085952-ea4f-4b27-956b-93bda81b8888 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:04.944338 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34085952-ea4f-4b27-956b-93bda81b8888 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:04.958953 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-34085952-ea4f-4b27-956b-93bda81b8888 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:38:04.958953 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:04.958953 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:04.958953 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:04.958953 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:04.958953 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:04.958953 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:04.958953 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:04.958953 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:04.958953 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:04.958953 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:04.958953 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:04.958953 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:38:04.958953 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:38:04.958953 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:38:04.959885 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:38:04.959885 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:04.959885 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:04.959885 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:04.959885 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:04.959885 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:04.959885 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:04.959885 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:04.959885 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:04.959885 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:04.959885 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:04.959885 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:04.959885 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:04.959885 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:04.959885 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:04.959885 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:04.959885 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:04.961337 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:38:04.961337 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:38:04.961337 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:38:04.961337 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:38:04.961337 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:38:04.961337 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:38:04.961337 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:38:04.961337 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:04.961337 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 317/634] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:38:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:04.961337 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34085952-ea4f-4b27-956b-93bda81b8888 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:04.972390 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0771ab-774c-4b3e-91dd-80db801b5901 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:04.990248 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:05.008050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4816b8-b08c-4947-b1af-ef68009ac9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:05.008869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4816b8-b08c-4947-b1af-ef68009ac9b4 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:05.009148 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4816b8-b08c-4947-b1af-ef68009ac9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:05.009415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4816b8-b08c-4947-b1af-ef68009ac9b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:05.020004 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4816b8-b08c-4947-b1af-ef68009ac9b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:05.021358 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4816b8-b08c-4947-b1af-ef68009ac9b4 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:05.038594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-0c4816b8-b08c-4947-b1af-ef68009ac9b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:05.038594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:05.038594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:05.038594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:05.038594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:05.038594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:05.038594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:05.038594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:05.038594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:05.038594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:05.038594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:05.038594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:05.038594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:38:05.038594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:38:05.038594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:38:05.039738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:38:05.039738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:05.039738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:05.039738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:05.039738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:05.039738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:05.039738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:05.039738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:05.039738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:05.039738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:05.039738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:05.039738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:05.039738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:05.039738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:05.039738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:05.039738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:05.039738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:05.040613 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:38:05.040613 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:38:05.040613 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:05.040613 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:05.040613 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 318/635] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:05.040613 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4816b8-b08c-4947-b1af-ef68009ac9b4 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:05.067064 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:05.080847 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34085952-ea4f-4b27-956b-93bda81b8888 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:05.113919 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535748e-52f5-4c2f-b684-4d1d3a82f58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:05.114719 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535748e-52f5-4c2f-b684-4d1d3a82f58a None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:05.115026 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535748e-52f5-4c2f-b684-4d1d3a82f58a None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:05.115299 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e535748e-52f5-4c2f-b684-4d1d3a82f58a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:05.125554 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e535748e-52f5-4c2f-b684-4d1d3a82f58a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:38:05.133212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-e535748e-52f5-4c2f-b684-4d1d3a82f58a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:38:05.133212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:05.133212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:05.133212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:05.133212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:05.133212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:05.133212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:05.133212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:05.133212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:05.133212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:05.133212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:05.133212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:05.133212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:38:05.133212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:38:05.133212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:38:05.133212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:38:05.134310 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:38:05.134310 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:38:05.134310 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:38:05.134310 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:38:05.134310 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:05.134310 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:05.134310 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:05.134310 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:05.134310 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:05.134310 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:05.134310 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:05.134310 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:05.134310 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:05.134310 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:05.134310 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:05.134310 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:05.135222 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:05.135222 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:05.135222 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:05.135222 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:05.135222 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:38:05.135222 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:38:05.135222 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:38:05.135222 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:38:05.135222 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:38:05.135222 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:38:05.135222 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:38:05.135222 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:05.135222 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 318/636] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jul 2 20:38:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:05.135222 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535748e-52f5-4c2f-b684-4d1d3a82f58a None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:05.158587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4816b8-b08c-4947-b1af-ef68009ac9b4 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:05.195597 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115ee67-3d90-48e5-b9e8-a3cc7d9a8d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:05.196651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115ee67-3d90-48e5-b9e8-a3cc7d9a8d98 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:05.197109 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115ee67-3d90-48e5-b9e8-a3cc7d9a8d98 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:05.197553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f115ee67-3d90-48e5-b9e8-a3cc7d9a8d98 None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:05.198625 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115ee67-3d90-48e5-b9e8-a3cc7d9a8d98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:05.199224 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115ee67-3d90-48e5-b9e8-a3cc7d9a8d98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:05.200842 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f115ee67-3d90-48e5-b9e8-a3cc7d9a8d98 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:05.214604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 319/637] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jul 2 20:38:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:05.215643 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115ee67-3d90-48e5-b9e8-a3cc7d9a8d98 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:05.226454 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:05.245994 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e535748e-52f5-4c2f-b684-4d1d3a82f58a None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:05.282559 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdccf0f-9e1f-4332-aaed-b2616918d5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:05.283264 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdccf0f-9e1f-4332-aaed-b2616918d5a7 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:05.283540 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdccf0f-9e1f-4332-aaed-b2616918d5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:05.283806 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdccf0f-9e1f-4332-aaed-b2616918d5a7 None admin] PATH_INFO: `/v3/domains` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:05.284524 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdccf0f-9e1f-4332-aaed-b2616918d5a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:05.284826 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdccf0f-9e1f-4332-aaed-b2616918d5a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:05.286194 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdccf0f-9e1f-4332-aaed-b2616918d5a7 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:05.298891 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 319/638] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:05.300186 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdccf0f-9e1f-4332-aaed-b2616918d5a7 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:05.306472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:05.327191 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f115ee67-3d90-48e5-b9e8-a3cc7d9a8d98 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:05.364808 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce4b4c-5652-4740-929b-a10ce87739a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:05.365471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce4b4c-5652-4740-929b-a10ce87739a2 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:05.365752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce4b4c-5652-4740-929b-a10ce87739a2 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:05.366025 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ce4b4c-5652-4740-929b-a10ce87739a2 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:05.366765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce4b4c-5652-4740-929b-a10ce87739a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:05.367098 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce4b4c-5652-4740-929b-a10ce87739a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:05.368471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ce4b4c-5652-4740-929b-a10ce87739a2 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:05.378011 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 320/639] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:38:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:05.379064 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce4b4c-5652-4740-929b-a10ce87739a2 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:05.414936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdccf0f-9e1f-4332-aaed-b2616918d5a7 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:05.454565 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255598c-80c1-4680-973d-7300f7d84def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:05.455252 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255598c-80c1-4680-973d-7300f7d84def None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:05.455536 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255598c-80c1-4680-973d-7300f7d84def None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:05.455821 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6255598c-80c1-4680-973d-7300f7d84def None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:05.456652 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255598c-80c1-4680-973d-7300f7d84def None admin] RBAC: Adding query filter params (role.id=09c018c7ef5249efb8f68eb74acafe13, scope.project.id=cd684ec63e1c4d61819302c837dd4349, user.id=bfcc022be567428db48e7b2a71d9c069) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:05.456960 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255598c-80c1-4680-973d-7300f7d84def None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:05.458459 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6255598c-80c1-4680-973d-7300f7d84def None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:05.465293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 320/640] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:38:05 2022] GET /identity/v3/role_assignments?user.id=bfcc022be567428db48e7b2a71d9c069&scope.project.id=cd684ec63e1c4d61819302c837dd4349&role.id=09c018c7ef5249efb8f68eb74acafe13 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:05.465968 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255598c-80c1-4680-973d-7300f7d84def None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:05.478743 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:05.518287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ce4b4c-5652-4740-929b-a10ce87739a2 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:05.559725 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3366426-ef2a-49bc-ba1c-530e48418241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:05.561360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3366426-ef2a-49bc-ba1c-530e48418241 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:05.561524 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3366426-ef2a-49bc-ba1c-530e48418241 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:05.561980 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3366426-ef2a-49bc-ba1c-530e48418241 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:05.570603 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3366426-ef2a-49bc-ba1c-530e48418241 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:05.572156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3366426-ef2a-49bc-ba1c-530e48418241 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:05.588590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-f3366426-ef2a-49bc-ba1c-530e48418241 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:38:05.588590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:05.588590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:05.588590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:05.588590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:05.588590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:05.588590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:05.588590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:05.588590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:05.588590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:05.588590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:05.588590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:05.588590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:38:05.588590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:38:05.588590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:38:05.589662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:38:05.589662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:05.589662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:05.589662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:05.589662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:05.589662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:05.589662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:05.589662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:05.589662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:05.589662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:05.589662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:05.589662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:05.589662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:05.589662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:05.589662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:05.589662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:05.589662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:05.590622 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:38:05.590622 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:38:05.590622 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:38:05.590622 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:38:05.590622 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:38:05.590622 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:38:05.590622 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:38:05.590622 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:05.593729 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6255598c-80c1-4680-973d-7300f7d84def None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:05.595174 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 321/641] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:38:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:05.596143 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3366426-ef2a-49bc-ba1c-530e48418241 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:05.599185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:05.634338 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ee27d-1be7-496a-b303-a78e7343b560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:05.635769 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ee27d-1be7-496a-b303-a78e7343b560 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:05.636269 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ee27d-1be7-496a-b303-a78e7343b560 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:05.636755 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830ee27d-1be7-496a-b303-a78e7343b560 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:05.649679 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ee27d-1be7-496a-b303-a78e7343b560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:05.651605 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830ee27d-1be7-496a-b303-a78e7343b560 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:05.671345 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-830ee27d-1be7-496a-b303-a78e7343b560 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:05.671345 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:05.671345 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:05.671345 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:05.671345 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:05.671345 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:05.671345 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:05.671345 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:05.671345 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:05.671345 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:05.671345 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:05.671345 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:05.671345 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:38:05.671345 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:38:05.671345 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:38:05.672480 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:38:05.672480 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:05.672480 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:05.672480 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:05.672480 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:05.672480 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:05.672480 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:05.672480 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:05.672480 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:05.672480 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:05.672480 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:05.672480 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:05.672480 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:05.672480 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:05.672480 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:05.672480 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:05.672480 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:05.673574 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:38:05.673574 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:38:05.673574 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:05.673574 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:05.675093 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 321/642] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:05.680649 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ee27d-1be7-496a-b303-a78e7343b560 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:05.718399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3366426-ef2a-49bc-ba1c-530e48418241 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:05.756801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce9ea2-da8e-4a24-b3fa-4e1063a62b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:05.757565 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce9ea2-da8e-4a24-b3fa-4e1063a62b9c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:05.758118 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:05.758772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce9ea2-da8e-4a24-b3fa-4e1063a62b9c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:05.759166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce9ea2-da8e-4a24-b3fa-4e1063a62b9c None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:05.760090 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce9ea2-da8e-4a24-b3fa-4e1063a62b9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:05.760656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce9ea2-da8e-4a24-b3fa-4e1063a62b9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:05.762266 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ce9ea2-da8e-4a24-b3fa-4e1063a62b9c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:05.782080 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 322/643] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jul 2 20:38:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:05.787905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce9ea2-da8e-4a24-b3fa-4e1063a62b9c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:05.802971 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830ee27d-1be7-496a-b303-a78e7343b560 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:05.838501 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa4ef0-6d42-4551-ac1b-e435e2545ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:05.839297 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa4ef0-6d42-4551-ac1b-e435e2545ead None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:05.839703 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa4ef0-6d42-4551-ac1b-e435e2545ead None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:05.840173 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa4ef0-6d42-4551-ac1b-e435e2545ead None admin] PATH_INFO: `/v3/domains` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:05.841055 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa4ef0-6d42-4551-ac1b-e435e2545ead None admin] RBAC: Adding query filter params (name=Default) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:05.841457 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa4ef0-6d42-4551-ac1b-e435e2545ead None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:05.842924 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa4ef0-6d42-4551-ac1b-e435e2545ead None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:05.851308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:05.856057 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 322/644] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:05.861128 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa4ef0-6d42-4551-ac1b-e435e2545ead None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:05.895946 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ce9ea2-da8e-4a24-b3fa-4e1063a62b9c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:05.933660 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a63743-1662-4677-9bf9-f1c8dd04386c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:05.934243 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a63743-1662-4677-9bf9-f1c8dd04386c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:05.934525 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a63743-1662-4677-9bf9-f1c8dd04386c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:05.934800 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a63743-1662-4677-9bf9-f1c8dd04386c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:05.935665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a63743-1662-4677-9bf9-f1c8dd04386c None admin] RBAC: Adding query filter params (role.id=09c018c7ef5249efb8f68eb74acafe13, scope.project.id=cd684ec63e1c4d61819302c837dd4349, user.id=875c7134ed804201831348457be9d247) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:05.935977 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a63743-1662-4677-9bf9-f1c8dd04386c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:05.937640 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a63743-1662-4677-9bf9-f1c8dd04386c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:05.951953 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 323/645] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:38:05 2022] GET /identity/v3/role_assignments?user.id=875c7134ed804201831348457be9d247&scope.project.id=cd684ec63e1c4d61819302c837dd4349&role.id=09c018c7ef5249efb8f68eb74acafe13 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:05.986281 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa4ef0-6d42-4551-ac1b-e435e2545ead None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:06.012541 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:06.026549 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53610011-010c-4651-87de-4bda2f167b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:06.027585 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53610011-010c-4651-87de-4bda2f167b60 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:06.027963 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53610011-010c-4651-87de-4bda2f167b60 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:06.028353 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53610011-010c-4651-87de-4bda2f167b60 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:06.037041 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53610011-010c-4651-87de-4bda2f167b60 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:06.038686 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53610011-010c-4651-87de-4bda2f167b60 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:06.055000 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-53610011-010c-4651-87de-4bda2f167b60 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:38:06.055000 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:06.055000 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:06.055000 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:06.055000 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:06.055000 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:06.055000 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:06.055000 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:06.055000 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:06.055000 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:06.055000 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:06.055000 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:06.055000 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:38:06.055000 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:38:06.055000 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:38:06.055000 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:38:06.056183 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:06.056183 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:06.056183 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:38:06.056183 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:38:06.056183 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:38:06.056183 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:38:06.056183 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:06.056183 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:06.056183 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:06.056183 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:06.056183 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:06.056183 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:06.056183 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:06.056183 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:06.056183 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:06.056183 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:06.056183 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:06.056183 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:06.057329 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:06.057329 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:06.057329 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:38:06.057329 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:38:06.057329 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:38:06.057329 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:38:06.057329 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:38:06.057329 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:38:06.057329 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:38:06.057329 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:06.063198 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 323/646] 10.222.0.57 () {56 vars in 1093 bytes} [Sat Jul 2 20:38:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:38:06.065532 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a63743-1662-4677-9bf9-f1c8dd04386c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:06.177288 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a63743-1662-4677-9bf9-f1c8dd04386c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:06.204593 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:06.213909 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4214355-20c1-41e6-b7e7-c92699ad555f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:06.214590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4214355-20c1-41e6-b7e7-c92699ad555f None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:06.214867 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4214355-20c1-41e6-b7e7-c92699ad555f None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:06.215157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4214355-20c1-41e6-b7e7-c92699ad555f None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:06.215990 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4214355-20c1-41e6-b7e7-c92699ad555f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:06.216295 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4214355-20c1-41e6-b7e7-c92699ad555f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:06.217724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4214355-20c1-41e6-b7e7-c92699ad555f None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:06.242941 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 324/647] 10.222.0.57 () {56 vars in 1133 bytes} [Sat Jul 2 20:38:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:06.245575 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53610011-010c-4651-87de-4bda2f167b60 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:06.350448 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53610011-010c-4651-87de-4bda2f167b60 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:06.388764 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823ef75-5782-45aa-9d11-1d8221400466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:06.389411 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823ef75-5782-45aa-9d11-1d8221400466 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:06.390061 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823ef75-5782-45aa-9d11-1d8221400466 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:06.390061 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823ef75-5782-45aa-9d11-1d8221400466 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:06.441883 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:06.464064 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823ef75-5782-45aa-9d11-1d8221400466 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:06.465469 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4823ef75-5782-45aa-9d11-1d8221400466 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:06.571922 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 324/648] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:38:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 02 20:38:06.577113 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4214355-20c1-41e6-b7e7-c92699ad555f None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:06.596526 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d178a6f-02da-49ed-ae57-2af4d16c7be1 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:06.596809 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d178a6f-02da-49ed-ae57-2af4d16c7be1 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:06.597080 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d178a6f-02da-49ed-ae57-2af4d16c7be1 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:06.598699 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 325/649] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:38:06.603650 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ac4bf-5810-4d81-baa0-fad62f970f32 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:06.603937 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ac4bf-5810-4d81-baa0-fad62f970f32 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:06.604213 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1ac4bf-5810-4d81-baa0-fad62f970f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:06.623259 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-0d1ac4bf-5810-4d81-baa0-fad62f970f32 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:06.624750 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-0d1ac4bf-5810-4d81-baa0-fad62f970f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:06.689598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4214355-20c1-41e6-b7e7-c92699ad555f None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:06.707174 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 326/650] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:38:06.728918 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ac4bf-5810-4d81-baa0-fad62f970f32 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:06.741747 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:06.748975 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f58fa5-18fa-4b82-b935-999e027a550a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:06.750185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f58fa5-18fa-4b82-b935-999e027a550a None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:06.750747 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f58fa5-18fa-4b82-b935-999e027a550a None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:06.751168 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f58fa5-18fa-4b82-b935-999e027a550a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:06.766084 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f58fa5-18fa-4b82-b935-999e027a550a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:06.767979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f58fa5-18fa-4b82-b935-999e027a550a None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:06.792438 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-39f58fa5-18fa-4b82-b935-999e027a550a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:06.792438 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:06.792438 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:06.792438 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:06.792438 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:06.792438 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:06.792438 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:06.792438 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:06.792438 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:06.792438 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:06.792438 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:06.792438 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:06.792438 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:38:06.792438 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:38:06.792438 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:38:06.793585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:38:06.793585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:06.793585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:06.793585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:06.793585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:06.793585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:06.793585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:06.793585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:06.793585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:06.793585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:06.793585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:06.793585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:06.793585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:06.793585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:06.793585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:06.793585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:06.793585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:06.794668 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:38:06.794668 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:38:06.794668 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:06.794668 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:06.798984 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 325/651] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:06.802030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f58fa5-18fa-4b82-b935-999e027a550a None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:06.841654 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:06.865531 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1ac4bf-5810-4d81-baa0-fad62f970f32 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:06.902868 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309a1b9-0c80-4207-b6eb-9d8ddcd9ffcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:06.903772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309a1b9-0c80-4207-b6eb-9d8ddcd9ffcd None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:06.904120 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309a1b9-0c80-4207-b6eb-9d8ddcd9ffcd None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:06.904458 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309a1b9-0c80-4207-b6eb-9d8ddcd9ffcd None admin] PATH_INFO: `/v3/services/image` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:06.905231 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309a1b9-0c80-4207-b6eb-9d8ddcd9ffcd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:06.906770 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309a1b9-0c80-4207-b6eb-9d8ddcd9ffcd None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:06.920386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-6309a1b9-0c80-4207-b6eb-9d8ddcd9ffcd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 20:38:06.920386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:06.920386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:38:06.920386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:38:06.920386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:38:06.920386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:38:06.920386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:38:06.920386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:06.920386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 20:38:06.920386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:06.920386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:38:06.920386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:06.920386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:06.920386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:06.920386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:06.920386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:06.920386 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:06.921472 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:06.921472 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:06.921472 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:06.921472 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:06.921472 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:06.921472 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:06.921472 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:38:06.921472 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:38:06.921472 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:38:06.921472 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:38:06.921472 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:06.921472 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:06.921472 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:06.921472 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:06.921472 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:06.921472 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:06.922466 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:06.922466 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:06.922466 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:06.922466 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:06.922466 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:06.922466 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:06.922466 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:06.922466 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:06.922466 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:06.922466 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:06.922466 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:38:06.922466 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:06.922466 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 20:38:06.922466 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:06.926342 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f58fa5-18fa-4b82-b935-999e027a550a None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:06.926527 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 327/652] 10.222.0.57 () {56 vars in 1105 bytes} [Sat Jul 2 20:38:06 2022] GET /identity/v3/services/image => generated 86 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:38:06.927536 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309a1b9-0c80-4207-b6eb-9d8ddcd9ffcd None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:06.971522 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa669b-9acf-4a82-881a-fd8c0abe737b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:06.972853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa669b-9acf-4a82-881a-fd8c0abe737b None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:06.973547 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa669b-9acf-4a82-881a-fd8c0abe737b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:06.974015 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aa669b-9acf-4a82-881a-fd8c0abe737b None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:06.975209 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa669b-9acf-4a82-881a-fd8c0abe737b None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:06.976141 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa669b-9acf-4a82-881a-fd8c0abe737b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:06.977934 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aa669b-9acf-4a82-881a-fd8c0abe737b None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:07.000551 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 326/653] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:07.001024 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa669b-9acf-4a82-881a-fd8c0abe737b None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:07.012313 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:07.045479 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309a1b9-0c80-4207-b6eb-9d8ddcd9ffcd None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:07.090156 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b14f8-a4ca-448a-a8c5-64e6230f93c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:07.091398 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b14f8-a4ca-448a-a8c5-64e6230f93c6 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:07.092243 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b14f8-a4ca-448a-a8c5-64e6230f93c6 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:07.092710 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0b14f8-a4ca-448a-a8c5-64e6230f93c6 None admin] PATH_INFO: `/v3/services` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:07.094016 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b14f8-a4ca-448a-a8c5-64e6230f93c6 None admin] RBAC: Adding query filter params (name=image) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:07.094603 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b14f8-a4ca-448a-a8c5-64e6230f93c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:07.096765 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0b14f8-a4ca-448a-a8c5-64e6230f93c6 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:07.103181 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:07.104458 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 328/654] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:38:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:07.109966 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b14f8-a4ca-448a-a8c5-64e6230f93c6 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:07.114148 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aa669b-9acf-4a82-881a-fd8c0abe737b None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:07.156042 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec7190-21f7-408d-824f-234519316ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:07.156999 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec7190-21f7-408d-824f-234519316ce6 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:07.157374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec7190-21f7-408d-824f-234519316ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:07.157739 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec7190-21f7-408d-824f-234519316ce6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:07.166469 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec7190-21f7-408d-824f-234519316ce6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:07.168825 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ec7190-21f7-408d-824f-234519316ce6 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:07.191284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-97ec7190-21f7-408d-824f-234519316ce6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:38:07.191284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:07.191284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:07.191284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:07.191284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:07.191284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:07.191284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:07.191284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:07.191284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:07.191284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:07.191284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:07.191284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:07.191284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:38:07.191284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:38:07.191284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:38:07.192417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:38:07.192417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:07.192417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:07.192417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:07.192417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:07.192417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:07.192417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:07.192417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:07.192417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:07.192417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:07.192417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:07.192417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:07.192417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:07.192417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:07.192417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:07.192417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:07.192417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:07.193441 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:38:07.193441 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:38:07.193441 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:38:07.193441 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:38:07.193441 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:38:07.193441 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:38:07.193441 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:38:07.193441 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:07.194972 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 327/655] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:38:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:38:07.199469 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec7190-21f7-408d-824f-234519316ce6 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:07.242550 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0b14f8-a4ca-448a-a8c5-64e6230f93c6 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:07.287010 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d843a8c-868d-4ad9-ac1b-6e7dbdeb3801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:07.287782 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d843a8c-868d-4ad9-ac1b-6e7dbdeb3801 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:07.287971 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d843a8c-868d-4ad9-ac1b-6e7dbdeb3801 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:07.288220 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d843a8c-868d-4ad9-ac1b-6e7dbdeb3801 None admin] PATH_INFO: `/v3/services` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:07.288922 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d843a8c-868d-4ad9-ac1b-6e7dbdeb3801 None admin] RBAC: Adding query filter params (type=image) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:07.289220 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d843a8c-868d-4ad9-ac1b-6e7dbdeb3801 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:07.290595 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d843a8c-868d-4ad9-ac1b-6e7dbdeb3801 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:07.298611 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 329/656] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:38:07 2022] GET /identity/v3/services?type=image => generated 122 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:07.328168 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec7190-21f7-408d-824f-234519316ce6 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:07.367650 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46fe00-9f0d-4436-bb3c-b208ca8d2706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:07.368758 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46fe00-9f0d-4436-bb3c-b208ca8d2706 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:07.369242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46fe00-9f0d-4436-bb3c-b208ca8d2706 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:07.369731 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46fe00-9f0d-4436-bb3c-b208ca8d2706 None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:07.370754 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46fe00-9f0d-4436-bb3c-b208ca8d2706 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:07.371332 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46fe00-9f0d-4436-bb3c-b208ca8d2706 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:07.373081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46fe00-9f0d-4436-bb3c-b208ca8d2706 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:07.388101 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 328/657] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jul 2 20:38:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:07.397017 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d843a8c-868d-4ad9-ac1b-6e7dbdeb3801 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:07.397861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:07.504800 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d843a8c-868d-4ad9-ac1b-6e7dbdeb3801 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:07.540068 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3e067-6c51-4f09-95e2-76c2434b174e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:07.540728 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3e067-6c51-4f09-95e2-76c2434b174e None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:07.541005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3e067-6c51-4f09-95e2-76c2434b174e None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:07.541272 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3e067-6c51-4f09-95e2-76c2434b174e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:07.542099 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3e067-6c51-4f09-95e2-76c2434b174e None admin] RBAC: Adding query filter params (role.id=353a58700c5640988ce2c9012e847cf8, scope.project.id=cd684ec63e1c4d61819302c837dd4349, user.id=eec825336f2e408ebabdcfd29845d5ad) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:07.542404 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3e067-6c51-4f09-95e2-76c2434b174e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:07.543883 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3e067-6c51-4f09-95e2-76c2434b174e None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:07.550080 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 330/658] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:38:07 2022] GET /identity/v3/role_assignments?user.id=eec825336f2e408ebabdcfd29845d5ad&scope.project.id=cd684ec63e1c4d61819302c837dd4349&role.id=353a58700c5640988ce2c9012e847cf8 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:07.892138 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb44fd-229b-48bb-907d-e72362c5b8e6 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:07.892672 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb44fd-229b-48bb-907d-e72362c5b8e6 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:07.892672 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb44fd-229b-48bb-907d-e72362c5b8e6 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:07.894326 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 329/659] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:07.900030 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560024c-6274-43fc-8e8a-fd38879998fa None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:07.900324 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560024c-6274-43fc-8e8a-fd38879998fa None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:07.900606 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4560024c-6274-43fc-8e8a-fd38879998fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:07.917726 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-4560024c-6274-43fc-8e8a-fd38879998fa None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:07.918932 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-4560024c-6274-43fc-8e8a-fd38879998fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:07.979515 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:07.987477 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 331/660] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:38:08.010431 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb44fd-229b-48bb-907d-e72362c5b8e6 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:08.029990 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:08.120456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb44fd-229b-48bb-907d-e72362c5b8e6 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:08.160966 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67067df7-1dbf-46a7-b715-93ed912f51e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:08.161680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67067df7-1dbf-46a7-b715-93ed912f51e2 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:08.161958 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67067df7-1dbf-46a7-b715-93ed912f51e2 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:08.162232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67067df7-1dbf-46a7-b715-93ed912f51e2 None admin] PATH_INFO: `/v3/services/network` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:08.162886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67067df7-1dbf-46a7-b715-93ed912f51e2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:08.164294 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67067df7-1dbf-46a7-b715-93ed912f51e2 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:08.178574 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-67067df7-1dbf-46a7-b715-93ed912f51e2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 20:38:08.178574 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:08.178574 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:38:08.178574 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:38:08.178574 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:38:08.178574 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:38:08.178574 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:38:08.178574 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:08.178574 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 20:38:08.178574 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:08.178574 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:38:08.178574 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:08.178574 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:08.178574 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:08.178574 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:08.178574 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:08.178574 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:08.179649 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:08.179649 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:08.179649 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:08.179649 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:08.179649 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:08.179649 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:08.179649 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:38:08.179649 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:38:08.179649 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:38:08.179649 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:38:08.179649 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:08.179649 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:08.179649 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:08.179649 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:08.179649 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:08.179649 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:08.180969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:08.180969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:08.180969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:08.180969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:08.180969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:08.180969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:08.180969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:08.180969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:08.180969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:08.180969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:08.180969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:38:08.180969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:08.180969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 20:38:08.180969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:08.180969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 330/661] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:38:08 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:08.188542 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560024c-6274-43fc-8e8a-fd38879998fa None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:08.295424 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4560024c-6274-43fc-8e8a-fd38879998fa None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:08.333799 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480cc75c-eb81-4216-a4ed-34c06fc9b8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:08.334470 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cc75c-eb81-4216-a4ed-34c06fc9b8dc None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:08.334751 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cc75c-eb81-4216-a4ed-34c06fc9b8dc None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:08.335059 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cc75c-eb81-4216-a4ed-34c06fc9b8dc None admin] PATH_INFO: `/v3/services` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:08.335766 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480cc75c-eb81-4216-a4ed-34c06fc9b8dc None admin] RBAC: Adding query filter params (name=network) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:08.336259 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480cc75c-eb81-4216-a4ed-34c06fc9b8dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:08.337758 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480cc75c-eb81-4216-a4ed-34c06fc9b8dc None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:08.342532 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 332/662] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jul 2 20:38:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:08.352050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67067df7-1dbf-46a7-b715-93ed912f51e2 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:08.436798 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:08.444254 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4ebad-59a0-45dd-bb91-26d052da76f0 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:08.444851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4ebad-59a0-45dd-bb91-26d052da76f0 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:08.445326 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad4ebad-59a0-45dd-bb91-26d052da76f0 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:08.448901 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 333/663] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:08.454038 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644e582-f1e2-4478-ad93-dc696eb54b41 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:08.454613 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644e582-f1e2-4478-ad93-dc696eb54b41 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:08.455187 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644e582-f1e2-4478-ad93-dc696eb54b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:08.457092 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67067df7-1dbf-46a7-b715-93ed912f51e2 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:08.473383 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-f644e582-f1e2-4478-ad93-dc696eb54b41 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:08.475192 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-f644e582-f1e2-4478-ad93-dc696eb54b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:08.495679 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6bbbf-d8d5-4a60-a79d-4ad7876c1ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:08.497340 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6bbbf-d8d5-4a60-a79d-4ad7876c1ba2 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:08.497833 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6bbbf-d8d5-4a60-a79d-4ad7876c1ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:08.498388 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6bbbf-d8d5-4a60-a79d-4ad7876c1ba2 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:08.499370 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6bbbf-d8d5-4a60-a79d-4ad7876c1ba2 None admin] RBAC: Adding query filter params (type=network) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:08.499950 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6bbbf-d8d5-4a60-a79d-4ad7876c1ba2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:08.502520 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6bbbf-d8d5-4a60-a79d-4ad7876c1ba2 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:08.519040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 331/664] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jul 2 20:38:08 2022] GET /identity/v3/services?type=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:08.548679 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:08.561692 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 334/665] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:38:08.585803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6bbbf-d8d5-4a60-a79d-4ad7876c1ba2 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:08.697839 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6bbbf-d8d5-4a60-a79d-4ad7876c1ba2 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:08.737504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f56d83-f070-47fc-8e0a-c1a048c51f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:08.738422 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f56d83-f070-47fc-8e0a-c1a048c51f78 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:08.738705 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f56d83-f070-47fc-8e0a-c1a048c51f78 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:08.739135 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f56d83-f070-47fc-8e0a-c1a048c51f78 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:08.739792 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f56d83-f070-47fc-8e0a-c1a048c51f78 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:08.741168 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f56d83-f070-47fc-8e0a-c1a048c51f78 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:08.754068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-46f56d83-f070-47fc-8e0a-c1a048c51f78 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 20:38:08.754068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:08.754068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:38:08.754068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:38:08.754068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:38:08.754068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:38:08.754068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:38:08.754068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:08.754068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 20:38:08.754068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:08.754068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:38:08.754068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:08.754068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:08.754068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:08.754068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:08.754068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:08.755022 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:08.755022 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:08.755022 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:08.755022 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:08.755022 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:08.755022 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:08.755022 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:08.755022 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:38:08.755022 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:38:08.755022 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:38:08.755022 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:38:08.755022 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:08.755022 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:08.755022 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:08.755022 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:08.755022 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:08.755853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:08.755853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:08.755853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:08.755853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:08.755853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:08.755853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:08.755853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:08.755853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:08.755853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:08.755853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:08.755853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:08.755853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:38:08.755853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:08.755853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 20:38:08.755853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:08.755853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 332/666] 10.222.0.57 () {56 vars in 1129 bytes} [Sat Jul 2 20:38:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:08.761699 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644e582-f1e2-4478-ad93-dc696eb54b41 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:08.866209 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644e582-f1e2-4478-ad93-dc696eb54b41 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:08.901212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d5c78-1eea-46c1-8714-f91a2a0b96dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:08.901873 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d5c78-1eea-46c1-8714-f91a2a0b96dc None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:08.902151 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d5c78-1eea-46c1-8714-f91a2a0b96dc None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:08.902422 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d5c78-1eea-46c1-8714-f91a2a0b96dc None admin] PATH_INFO: `/v3/services` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:08.903174 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d5c78-1eea-46c1-8714-f91a2a0b96dc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:08.903476 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d5c78-1eea-46c1-8714-f91a2a0b96dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:08.904845 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d5c78-1eea-46c1-8714-f91a2a0b96dc None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:08.909691 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 335/667] 10.222.0.57 () {56 vars in 1124 bytes} [Sat Jul 2 20:38:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:08.915245 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f56d83-f070-47fc-8e0a-c1a048c51f78 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:08.934955 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:09.023396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f56d83-f070-47fc-8e0a-c1a048c51f78 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:09.058286 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca82c88-5919-4900-9998-36415b8c054f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:09.058985 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca82c88-5919-4900-9998-36415b8c054f None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:09.059268 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca82c88-5919-4900-9998-36415b8c054f None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:09.059538 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca82c88-5919-4900-9998-36415b8c054f None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:09.060245 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca82c88-5919-4900-9998-36415b8c054f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:09.060543 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca82c88-5919-4900-9998-36415b8c054f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:09.061981 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca82c88-5919-4900-9998-36415b8c054f None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:09.067210 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 333/668] 10.222.0.57 () {56 vars in 1124 bytes} [Sat Jul 2 20:38:08 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:09.680371 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a6e4c-71b6-4400-bec7-2c465f122622 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:09.681429 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a6e4c-71b6-4400-bec7-2c465f122622 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:09.681915 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a6e4c-71b6-4400-bec7-2c465f122622 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:09.683776 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 336/669] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:09.689353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ce01f-96f6-458e-8362-5d8e8fbface7 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:09.689908 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ce01f-96f6-458e-8362-5d8e8fbface7 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:09.690378 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ce01f-96f6-458e-8362-5d8e8fbface7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:09.719932 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-8e3ce01f-96f6-458e-8362-5d8e8fbface7 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:09.725873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-8e3ce01f-96f6-458e-8362-5d8e8fbface7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:09.797917 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 334/670] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:38:09.822137 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a6e4c-71b6-4400-bec7-2c465f122622 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:09.885805 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:09.932646 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a6e4c-71b6-4400-bec7-2c465f122622 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:09.966776 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc09db-8543-4355-83db-add833dd2ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:09.967463 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc09db-8543-4355-83db-add833dd2ea6 None admin] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:09.967739 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc09db-8543-4355-83db-add833dd2ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:09.968008 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc09db-8543-4355-83db-add833dd2ea6 None admin] PATH_INFO: `/v3/services` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:09.969047 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc09db-8543-4355-83db-add833dd2ea6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:09.970477 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc09db-8543-4355-83db-add833dd2ea6 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:09.982139 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785049f-d7bc-40c0-8990-93dc3527c203 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:09.982620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785049f-d7bc-40c0-8990-93dc3527c203 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:09.982698 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d785049f-d7bc-40c0-8990-93dc3527c203 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:09.984393 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 335/671] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:09.988332 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 337/672] 10.222.0.57 () {60 vars in 1141 bytes} [Sat Jul 2 20:38:09 2022] POST /identity/v3/services => generated 242 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:38:09.989685 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd0db7-23e9-4808-832d-d16e6ca60d9f None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:09.989974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd0db7-23e9-4808-832d-d16e6ca60d9f None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:09.990249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd0db7-23e9-4808-832d-d16e6ca60d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:09.995430 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:10.009325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-f9fd0db7-23e9-4808-832d-d16e6ca60d9f None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:10.010615 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-f9fd0db7-23e9-4808-832d-d16e6ca60d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:10.101416 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 336/673] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:09 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:38:10.126524 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc09db-8543-4355-83db-add833dd2ea6 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:10.237983 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc09db-8543-4355-83db-add833dd2ea6 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:10.253187 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:10.276294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f62e99-1d84-4f74-8208-4a990250fd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:10.277695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f62e99-1d84-4f74-8208-4a990250fd00 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:10.278212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f62e99-1d84-4f74-8208-4a990250fd00 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:10.278930 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f62e99-1d84-4f74-8208-4a990250fd00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:10.290406 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f62e99-1d84-4f74-8208-4a990250fd00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:38:10.299098 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-f8f62e99-1d84-4f74-8208-4a990250fd00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:38:10.299098 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:10.299098 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:10.299098 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:10.299098 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:10.299098 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:10.299098 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:10.299098 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:10.299098 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:10.299098 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:10.299098 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:10.299098 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:10.299098 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:38:10.299098 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:38:10.299098 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:38:10.299098 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:38:10.300097 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:38:10.300097 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:38:10.300097 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:38:10.300097 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:38:10.300097 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:10.300097 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:10.300097 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:10.300097 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:10.300097 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:10.300097 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:10.300097 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:10.300097 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:10.300097 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:10.300097 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:10.300097 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:10.300097 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:10.301244 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:10.301244 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:10.301244 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:10.301244 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:10.301244 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:38:10.301244 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:38:10.301244 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:38:10.301244 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:38:10.301244 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:38:10.301244 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:38:10.301244 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:38:10.301244 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:10.301244 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 338/674] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jul 2 20:38:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:10.308523 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd0db7-23e9-4808-832d-d16e6ca60d9f None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:10.419436 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd0db7-23e9-4808-832d-d16e6ca60d9f None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:10.447194 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:10.455778 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a717ac-f9e4-4523-9bfb-52ef72bd5d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:10.456633 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a717ac-f9e4-4523-9bfb-52ef72bd5d75 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:10.457143 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a717ac-f9e4-4523-9bfb-52ef72bd5d75 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:10.457421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a717ac-f9e4-4523-9bfb-52ef72bd5d75 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:10.458176 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a717ac-f9e4-4523-9bfb-52ef72bd5d75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:10.458489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a717ac-f9e4-4523-9bfb-52ef72bd5d75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:10.459914 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a717ac-f9e4-4523-9bfb-52ef72bd5d75 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:10.469159 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 337/675] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:38:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:10.474861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f62e99-1d84-4f74-8208-4a990250fd00 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:10.578306 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f62e99-1d84-4f74-8208-4a990250fd00 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:10.615643 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629a956-0888-4545-a335-d160123fa38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:10.616841 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629a956-0888-4545-a335-d160123fa38f None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:10.617323 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629a956-0888-4545-a335-d160123fa38f None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:10.617973 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c629a956-0888-4545-a335-d160123fa38f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:10.629396 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629a956-0888-4545-a335-d160123fa38f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:10.631153 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c629a956-0888-4545-a335-d160123fa38f None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:10.648732 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-c629a956-0888-4545-a335-d160123fa38f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:10.648732 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:10.648732 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:10.648732 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:10.648732 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:10.648732 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:10.648732 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:10.648732 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:10.648732 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:10.648732 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:10.648732 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:10.648732 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:10.648732 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:38:10.648732 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:38:10.648732 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:38:10.649599 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:38:10.649599 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:10.649599 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:10.649599 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:10.649599 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:10.649599 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:10.649599 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:10.649599 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:10.649599 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:10.649599 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:10.649599 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:10.649599 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:10.649599 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:10.649599 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:10.649599 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:10.649599 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:10.649599 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:10.650488 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:38:10.650488 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:38:10.650488 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:10.650488 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:10.657092 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 339/676] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:10.658786 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a717ac-f9e4-4523-9bfb-52ef72bd5d75 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:10.765697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a717ac-f9e4-4523-9bfb-52ef72bd5d75 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:10.800361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8cb1a7-fae8-4215-aeda-22b3fee0e056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:10.801525 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cb1a7-fae8-4215-aeda-22b3fee0e056 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:10.802012 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cb1a7-fae8-4215-aeda-22b3fee0e056 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:10.802558 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cb1a7-fae8-4215-aeda-22b3fee0e056 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:10.803513 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8cb1a7-fae8-4215-aeda-22b3fee0e056 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:10.804021 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8cb1a7-fae8-4215-aeda-22b3fee0e056 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:10.805619 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8cb1a7-fae8-4215-aeda-22b3fee0e056 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:10.823142 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 338/677] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:10.824787 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629a956-0888-4545-a335-d160123fa38f None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:10.855465 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:10.938426 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c629a956-0888-4545-a335-d160123fa38f None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:10.974173 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd56bf9-ca51-41ba-b02e-84381021b730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:10.975006 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd56bf9-ca51-41ba-b02e-84381021b730 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:10.975294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd56bf9-ca51-41ba-b02e-84381021b730 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:10.975570 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd56bf9-ca51-41ba-b02e-84381021b730 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:10.983608 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd56bf9-ca51-41ba-b02e-84381021b730 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:10.985811 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd56bf9-ca51-41ba-b02e-84381021b730 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:11.000896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbadbb3-9d40-4db0-89e3-633a817c09ef None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:11.001446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-bcd56bf9-ca51-41ba-b02e-84381021b730 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:38:11.001446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:11.001446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:11.001446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:11.001446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:11.001446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:11.001446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:11.001446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:11.001446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:11.001446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:11.001446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:11.001446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:11.001446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:38:11.001446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:38:11.001446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:38:11.001446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:38:11.002304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:11.002304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:11.002304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:38:11.002304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:38:11.002304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:38:11.002304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:38:11.002304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:11.002304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:11.002304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:11.002304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:11.002304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:11.002304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:11.002304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:11.002304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:11.002304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:11.002304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:11.002304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:11.002304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:11.003460 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:11.003460 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:11.003460 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:38:11.003460 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:38:11.003460 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:38:11.003460 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:38:11.003460 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:38:11.003460 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:38:11.003460 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:38:11.003460 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:11.003460 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 340/678] 10.222.0.57 () {56 vars in 1093 bytes} [Sat Jul 2 20:38:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:11.007780 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbadbb3-9d40-4db0-89e3-633a817c09ef None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:11.008264 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbadbb3-9d40-4db0-89e3-633a817c09ef None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:11.008365 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd56bf9-ca51-41ba-b02e-84381021b730 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:11.014222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 339/679] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:10 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:11.016352 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867ff6f-368f-4011-8745-1ad13beb22a8 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:11.016854 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867ff6f-368f-4011-8745-1ad13beb22a8 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:11.017361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867ff6f-368f-4011-8745-1ad13beb22a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:11.036381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-2867ff6f-368f-4011-8745-1ad13beb22a8 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:11.038000 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-2867ff6f-368f-4011-8745-1ad13beb22a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:11.095784 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:11.106884 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:11.128056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 340/680] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:11 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 02 20:38:11.128482 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd56bf9-ca51-41ba-b02e-84381021b730 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:11.152375 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867ff6f-368f-4011-8745-1ad13beb22a8 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:11.171113 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1b872-1cc7-4154-9a47-5c24803aa185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:11.172537 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1b872-1cc7-4154-9a47-5c24803aa185 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:11.173035 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1b872-1cc7-4154-9a47-5c24803aa185 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:11.174001 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1b872-1cc7-4154-9a47-5c24803aa185 None admin] PATH_INFO: `/v3/users` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:11.175098 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1b872-1cc7-4154-9a47-5c24803aa185 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:11.175601 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1b872-1cc7-4154-9a47-5c24803aa185 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:11.178046 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a1b872-1cc7-4154-9a47-5c24803aa185 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:11.207263 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 341/681] 10.222.0.57 () {56 vars in 1133 bytes} [Sat Jul 2 20:38:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:38:11.209619 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1b872-1cc7-4154-9a47-5c24803aa185 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:11.300826 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867ff6f-368f-4011-8745-1ad13beb22a8 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:11.336689 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a1b872-1cc7-4154-9a47-5c24803aa185 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:11.381728 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf88d4-5fe2-4b1e-9ecc-caf2055d5cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:11.382466 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf88d4-5fe2-4b1e-9ecc-caf2055d5cdc None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:11.382747 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf88d4-5fe2-4b1e-9ecc-caf2055d5cdc None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:11.383054 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf88d4-5fe2-4b1e-9ecc-caf2055d5cdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:11.396018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d661b-fcc9-49ae-9429-ddd279539e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:11.396700 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d661b-fcc9-49ae-9429-ddd279539e00 None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:11.396981 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d661b-fcc9-49ae-9429-ddd279539e00 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:11.397257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d661b-fcc9-49ae-9429-ddd279539e00 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:11.398009 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d661b-fcc9-49ae-9429-ddd279539e00 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:11.399437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d661b-fcc9-49ae-9429-ddd279539e00 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:11.408250 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf88d4-5fe2-4b1e-9ecc-caf2055d5cdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:11.409792 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf88d4-5fe2-4b1e-9ecc-caf2055d5cdc None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:11.420070 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:11.436616 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 341/682] 10.222.0.57 () {60 vars in 1141 bytes} [Sat Jul 2 20:38:11 2022] POST /identity/v3/services => generated 240 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:38:11.444575 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-4ccf88d4-5fe2-4b1e-9ecc-caf2055d5cdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:11.444575 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:11.444575 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:11.444575 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:11.444575 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:11.444575 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:11.444575 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:11.444575 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:11.444575 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:11.444575 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:11.444575 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:11.444575 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:11.444575 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:38:11.444575 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:38:11.444575 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:38:11.445695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:38:11.445695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:11.445695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:11.445695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:11.445695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:11.445695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:11.445695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:11.445695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:11.445695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:11.445695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:11.445695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:11.445695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:11.445695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:11.445695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:11.445695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:11.445695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:11.445695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:11.446580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:38:11.446580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:38:11.446580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:11.446580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:11.449242 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 342/683] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:38:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:11.458063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d661b-fcc9-49ae-9429-ddd279539e00 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:11.502378 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cd1b1-c1fb-40ce-91ee-cfc86d904e44 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:11.503027 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cd1b1-c1fb-40ce-91ee-cfc86d904e44 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:11.504427 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cd1b1-c1fb-40ce-91ee-cfc86d904e44 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:11.506483 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 343/684] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:38:11.511526 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:11.514081 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df37fb-58ba-46be-aac5-1fd54f57eabf None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:11.514851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df37fb-58ba-46be-aac5-1fd54f57eabf None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:11.515444 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73df37fb-58ba-46be-aac5-1fd54f57eabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:11.536856 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-73df37fb-58ba-46be-aac5-1fd54f57eabf None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:11.538423 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-73df37fb-58ba-46be-aac5-1fd54f57eabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:11.583631 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d661b-fcc9-49ae-9429-ddd279539e00 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:11.621630 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c076352-3f74-4b01-b944-f65f8a444ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:11.627224 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c076352-3f74-4b01-b944-f65f8a444ec2 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:11.627224 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c076352-3f74-4b01-b944-f65f8a444ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:11.627224 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c076352-3f74-4b01-b944-f65f8a444ec2 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:11.627224 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c076352-3f74-4b01-b944-f65f8a444ec2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:11.627224 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c076352-3f74-4b01-b944-f65f8a444ec2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:11.627224 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c076352-3f74-4b01-b944-f65f8a444ec2 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:11.628394 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 344/685] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:11 2022] POST /identity/v3/auth/tokens => generated 994 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 02 20:38:11.638957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 342/686] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:11.644827 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df37fb-58ba-46be-aac5-1fd54f57eabf None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:11.652814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c076352-3f74-4b01-b944-f65f8a444ec2 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:11.772975 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73df37fb-58ba-46be-aac5-1fd54f57eabf None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:11.775900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c076352-3f74-4b01-b944-f65f8a444ec2 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:11.787308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:11.804368 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:11.815062 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43bb58-ec85-4813-88be-d8271f986fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:11.815537 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6108c5f-953f-4ed9-b610-0bc2f2253ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:11.815854 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43bb58-ec85-4813-88be-d8271f986fef None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:11.816134 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43bb58-ec85-4813-88be-d8271f986fef None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:11.816402 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43bb58-ec85-4813-88be-d8271f986fef None admin] PATH_INFO: `/v3/projects/service` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:11.817051 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6108c5f-953f-4ed9-b610-0bc2f2253ad3 None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:11.817543 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6108c5f-953f-4ed9-b610-0bc2f2253ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:11.818011 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6108c5f-953f-4ed9-b610-0bc2f2253ad3 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:11.819295 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6108c5f-953f-4ed9-b610-0bc2f2253ad3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:11.820891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6108c5f-953f-4ed9-b610-0bc2f2253ad3 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:11.823606 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43bb58-ec85-4813-88be-d8271f986fef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:11.825610 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43bb58-ec85-4813-88be-d8271f986fef None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:11.838303 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 343/687] 10.222.0.57 () {60 vars in 1141 bytes} [Sat Jul 2 20:38:11 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:38:11.842981 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-ca43bb58-ec85-4813-88be-d8271f986fef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:38:11.842981 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:11.842981 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:11.842981 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:11.842981 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:11.842981 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:11.842981 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:11.842981 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:11.842981 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:11.842981 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:11.842981 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:11.842981 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:11.842981 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:38:11.842981 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:38:11.842981 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:38:11.843958 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:38:11.843958 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:11.843958 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:11.843958 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:11.843958 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:11.843958 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:11.843958 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:11.843958 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:11.843958 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:11.843958 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:11.843958 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:11.843958 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:11.843958 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:11.843958 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:11.843958 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:11.843958 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:11.843958 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:11.844936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:38:11.844936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:38:11.844936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:38:11.844936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:38:11.844936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:38:11.844936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:38:11.844936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:38:11.844936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:11.844936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 345/688] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:38:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:11.854947 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6108c5f-953f-4ed9-b610-0bc2f2253ad3 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:11.976585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6108c5f-953f-4ed9-b610-0bc2f2253ad3 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:12.013052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d5884-20cb-4b0c-96b8-0e0b04824ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:12.013793 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d5884-20cb-4b0c-96b8-0e0b04824ee1 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:12.014075 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d5884-20cb-4b0c-96b8-0e0b04824ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:12.014392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d5884-20cb-4b0c-96b8-0e0b04824ee1 None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:12.015487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d5884-20cb-4b0c-96b8-0e0b04824ee1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:12.015805 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d5884-20cb-4b0c-96b8-0e0b04824ee1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:12.017462 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d5884-20cb-4b0c-96b8-0e0b04824ee1 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:12.031157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 344/689] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jul 2 20:38:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:12.037304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43bb58-ec85-4813-88be-d8271f986fef None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:12.144224 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43bb58-ec85-4813-88be-d8271f986fef None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:12.183249 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8cb71e-36a2-4b5c-b277-d6c5a27a0fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:12.184151 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cb71e-36a2-4b5c-b277-d6c5a27a0fc1 None admin] REQUEST_METHOD: `PUT` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:12.184432 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cb71e-36a2-4b5c-b277-d6c5a27a0fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:12.184706 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8cb71e-36a2-4b5c-b277-d6c5a27a0fc1 None admin] PATH_INFO: `/v3/projects/cd684ec63e1c4d61819302c837dd4349/users/eec825336f2e408ebabdcfd29845d5ad/roles/353a58700c5640988ce2c9012e847cf8` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:12.186758 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cb71e-36a2-4b5c-b277-d6c5a27a0fc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd684ec63e1c4d61819302c837dd4349, user_id=eec825336f2e408ebabdcfd29845d5ad, role_id=353a58700c5640988ce2c9012e847cf8)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:12.188360 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8cb71e-36a2-4b5c-b277-d6c5a27a0fc1 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:12.205440 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 346/690] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jul 2 20:38:12 2022] PUT /identity/v3/projects/cd684ec63e1c4d61819302c837dd4349/users/eec825336f2e408ebabdcfd29845d5ad/roles/353a58700c5640988ce2c9012e847cf8 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:38:12.398824 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285167ae-734c-4395-8cdf-5a091ba2603f None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:12.399254 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285167ae-734c-4395-8cdf-5a091ba2603f None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:12.399428 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285167ae-734c-4395-8cdf-5a091ba2603f None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:12.401052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 345/691] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:12.406372 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5a189-5ee4-4bfd-8a5b-2df870f0f6c9 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:12.406662 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5a189-5ee4-4bfd-8a5b-2df870f0f6c9 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:12.407031 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5a189-5ee4-4bfd-8a5b-2df870f0f6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:12.426985 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-22c5a189-5ee4-4bfd-8a5b-2df870f0f6c9 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:12.428188 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-22c5a189-5ee4-4bfd-8a5b-2df870f0f6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:12.473258 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:12.500665 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 347/692] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:12 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:38:12.524166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285167ae-734c-4395-8cdf-5a091ba2603f None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:12.540508 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:12.634585 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285167ae-734c-4395-8cdf-5a091ba2603f None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:12.669721 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b8dd5-a71f-43c1-9c72-97c2537a6832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:12.670449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b8dd5-a71f-43c1-9c72-97c2537a6832 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:12.670723 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b8dd5-a71f-43c1-9c72-97c2537a6832 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:12.671034 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b8dd5-a71f-43c1-9c72-97c2537a6832 None admin] PATH_INFO: `/v3/services/image` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:12.671844 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b8dd5-a71f-43c1-9c72-97c2537a6832 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:12.673244 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b8dd5-a71f-43c1-9c72-97c2537a6832 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:12.685337 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-b69b8dd5-a71f-43c1-9c72-97c2537a6832 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 20:38:12.685337 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:12.685337 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:38:12.685337 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:38:12.685337 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:38:12.685337 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:38:12.685337 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:38:12.685337 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:12.685337 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 20:38:12.685337 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:12.685337 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:38:12.685337 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:12.685337 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:12.685337 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:12.685337 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:12.685337 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:12.685337 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:12.686419 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:12.686419 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:12.686419 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:12.686419 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:12.686419 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:12.686419 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:12.686419 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:38:12.686419 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:38:12.686419 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:38:12.686419 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:38:12.686419 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:12.686419 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:12.686419 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:12.686419 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:12.686419 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:12.686419 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:12.687320 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:12.687320 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:12.687320 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:12.687320 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:12.687320 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:12.687320 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:12.687320 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:12.687320 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:12.687320 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:12.687320 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:12.687320 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:38:12.687320 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:12.687320 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 20:38:12.687320 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:12.687320 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 346/693] 10.222.0.57 () {56 vars in 1105 bytes} [Sat Jul 2 20:38:12 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:12.700311 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5a189-5ee4-4bfd-8a5b-2df870f0f6c9 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:12.812606 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5a189-5ee4-4bfd-8a5b-2df870f0f6c9 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:12.847589 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e8809-0575-4643-a7b7-75f4699cff9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:12.848332 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e8809-0575-4643-a7b7-75f4699cff9b None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:12.848535 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e8809-0575-4643-a7b7-75f4699cff9b None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:12.848810 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69e8809-0575-4643-a7b7-75f4699cff9b None admin] PATH_INFO: `/v3/services` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:12.849513 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e8809-0575-4643-a7b7-75f4699cff9b None admin] RBAC: Adding query filter params (name=image) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:12.849819 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e8809-0575-4643-a7b7-75f4699cff9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:12.851229 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69e8809-0575-4643-a7b7-75f4699cff9b None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:12.856238 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 348/694] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:38:12 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:12.861891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b8dd5-a71f-43c1-9c72-97c2537a6832 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:12.938353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:12.961628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b8dd5-a71f-43c1-9c72-97c2537a6832 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:12.996888 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219543c-5230-493b-a5dd-7e01f2a8163c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:12.997562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219543c-5230-493b-a5dd-7e01f2a8163c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:12.997843 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219543c-5230-493b-a5dd-7e01f2a8163c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:12.998114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1219543c-5230-493b-a5dd-7e01f2a8163c None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:12.998817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219543c-5230-493b-a5dd-7e01f2a8163c None admin] RBAC: Adding query filter params (type=image) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:12.999141 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219543c-5230-493b-a5dd-7e01f2a8163c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:13.000755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1219543c-5230-493b-a5dd-7e01f2a8163c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:13.009943 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 347/695] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:38:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:13.015981 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e8809-0575-4643-a7b7-75f4699cff9b None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:13.057360 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:13.120835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69e8809-0575-4643-a7b7-75f4699cff9b None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:13.157249 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ea43de-5e01-46a4-b0a6-e18d07d24662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:13.157911 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea43de-5e01-46a4-b0a6-e18d07d24662 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:13.158186 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea43de-5e01-46a4-b0a6-e18d07d24662 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:13.158456 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ea43de-5e01-46a4-b0a6-e18d07d24662 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:13.159255 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea43de-5e01-46a4-b0a6-e18d07d24662 None admin] RBAC: Adding query filter params (interface=public, service_id=3c067ebd358b4479b3f35602a6cb8777, region_id=RegionOne) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:13.159562 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea43de-5e01-46a4-b0a6-e18d07d24662 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:13.161025 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ea43de-5e01-46a4-b0a6-e18d07d24662 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:13.168938 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 349/696] 10.222.0.57 () {56 vars in 1251 bytes} [Sat Jul 2 20:38:13 2022] GET /identity/v3/endpoints?service_id=3c067ebd358b4479b3f35602a6cb8777&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:13.174698 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219543c-5230-493b-a5dd-7e01f2a8163c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:13.279624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1219543c-5230-493b-a5dd-7e01f2a8163c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:13.314157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31db7b6-d400-40ad-bd2a-bcf5b3e0bf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:13.314887 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31db7b6-d400-40ad-bd2a-bcf5b3e0bf93 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:13.315203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31db7b6-d400-40ad-bd2a-bcf5b3e0bf93 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:13.315529 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31db7b6-d400-40ad-bd2a-bcf5b3e0bf93 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:13.316212 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31db7b6-d400-40ad-bd2a-bcf5b3e0bf93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:13.317608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31db7b6-d400-40ad-bd2a-bcf5b3e0bf93 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:13.323739 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 348/697] 10.222.0.57 () {56 vars in 1087 bytes} [Sat Jul 2 20:38:13 2022] GET /identity/v3/services => generated 1002 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 20:38:13.989642 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d990c-5c91-4151-b112-86f4b890839c None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:13.990147 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d990c-5c91-4151-b112-86f4b890839c None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:13.990147 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654d990c-5c91-4151-b112-86f4b890839c None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:13.991858 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 350/698] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:13.997415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0662fb-d67e-4e0e-8cda-7d720a2d2c73 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:13.997710 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0662fb-d67e-4e0e-8cda-7d720a2d2c73 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:13.997992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0662fb-d67e-4e0e-8cda-7d720a2d2c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:14.004260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:14.015645 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-5a0662fb-d67e-4e0e-8cda-7d720a2d2c73 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:14.017303 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-5a0662fb-d67e-4e0e-8cda-7d720a2d2c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:14.099023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 349/699] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:13 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:38:14.117285 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d990c-5c91-4151-b112-86f4b890839c None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:14.228852 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654d990c-5c91-4151-b112-86f4b890839c None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:14.231241 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:14.264204 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417322ea-41b1-433b-b00f-39c17963df0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:14.265181 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417322ea-41b1-433b-b00f-39c17963df0c None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:14.265479 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417322ea-41b1-433b-b00f-39c17963df0c None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:14.265751 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417322ea-41b1-433b-b00f-39c17963df0c None admin] PATH_INFO: `/v3/services/network` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:14.266394 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417322ea-41b1-433b-b00f-39c17963df0c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:14.267792 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417322ea-41b1-433b-b00f-39c17963df0c None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:14.279696 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-417322ea-41b1-433b-b00f-39c17963df0c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 20:38:14.279696 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:14.279696 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:38:14.279696 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:38:14.279696 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:38:14.279696 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:38:14.279696 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:38:14.279696 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:14.279696 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 20:38:14.279696 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:14.279696 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:38:14.279696 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:14.279696 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:14.279696 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:14.279696 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:14.279696 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:14.279696 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:14.280755 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:14.280755 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:14.280755 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:14.280755 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:14.280755 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:14.280755 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:14.280755 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:38:14.280755 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:38:14.280755 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:38:14.280755 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:38:14.280755 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:14.280755 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:14.280755 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:14.280755 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:14.280755 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:14.280755 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:14.281589 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:14.281589 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:14.281589 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:14.281589 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:14.281589 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:14.281589 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:14.281589 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:14.281589 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:14.281589 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:14.281589 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:14.281589 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:38:14.281589 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:14.281589 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 20:38:14.281589 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:14.281589 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 351/700] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:38:14 2022] GET /identity/v3/services/network => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:14.287269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0662fb-d67e-4e0e-8cda-7d720a2d2c73 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:14.316187 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea1aae-9fa6-458d-9d7f-894579c4d2b5 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:14.316521 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea1aae-9fa6-458d-9d7f-894579c4d2b5 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:14.316899 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ea1aae-9fa6-458d-9d7f-894579c4d2b5 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:14.318891 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 352/701] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:14.326631 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ede2d3-629c-4d3f-b1f1-6990cd8a6657 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:14.326936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ede2d3-629c-4d3f-b1f1-6990cd8a6657 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:14.327212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ede2d3-629c-4d3f-b1f1-6990cd8a6657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:14.346597 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-58ede2d3-629c-4d3f-b1f1-6990cd8a6657 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:14.347838 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-58ede2d3-629c-4d3f-b1f1-6990cd8a6657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:14.395357 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0662fb-d67e-4e0e-8cda-7d720a2d2c73 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:14.423389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 353/702] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:14 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 20:38:14.432219 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416f628-4490-45af-ad4e-ed58edd8fd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:14.433032 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416f628-4490-45af-ad4e-ed58edd8fd68 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:14.433453 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416f628-4490-45af-ad4e-ed58edd8fd68 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:14.433835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416f628-4490-45af-ad4e-ed58edd8fd68 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:14.434729 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416f628-4490-45af-ad4e-ed58edd8fd68 None admin] RBAC: Adding query filter params (name=network) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:14.435186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416f628-4490-45af-ad4e-ed58edd8fd68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:14.436788 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416f628-4490-45af-ad4e-ed58edd8fd68 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:14.442248 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ede2d3-629c-4d3f-b1f1-6990cd8a6657 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:14.447304 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:14.447632 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 350/703] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jul 2 20:38:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:14.448893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416f628-4490-45af-ad4e-ed58edd8fd68 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:14.545846 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:14.549606 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ede2d3-629c-4d3f-b1f1-6990cd8a6657 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:14.562027 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416f628-4490-45af-ad4e-ed58edd8fd68 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:14.586207 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9eab4-756a-42c3-8359-2a11113fc516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:14.587056 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9eab4-756a-42c3-8359-2a11113fc516 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:14.587335 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9eab4-756a-42c3-8359-2a11113fc516 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:14.587604 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9eab4-756a-42c3-8359-2a11113fc516 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:14.588251 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9eab4-756a-42c3-8359-2a11113fc516 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:14.589859 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9eab4-756a-42c3-8359-2a11113fc516 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:14.601745 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7eee3-9e9b-461b-8797-6c3e11372291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:14.602117 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-ecc9eab4-756a-42c3-8359-2a11113fc516 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 20:38:14.602117 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:14.602117 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:38:14.602117 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:38:14.602117 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:38:14.602117 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:38:14.602117 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:38:14.602117 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:14.602117 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 20:38:14.602117 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:14.602117 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:38:14.602117 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:14.602117 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:14.602117 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:14.602117 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:14.602117 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:14.603335 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:14.603335 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:14.603335 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:14.603335 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:14.603335 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:14.603335 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:14.603335 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:14.603335 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:38:14.603335 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:38:14.603335 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:38:14.603335 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:38:14.603335 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:14.603335 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:14.603335 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:14.603335 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:14.603335 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:14.604166 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:14.604166 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:14.604166 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:14.604166 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:14.604166 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:14.604166 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:14.604166 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:14.604166 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:14.604166 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:14.604166 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:14.604166 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:14.604166 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:38:14.604166 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:14.604166 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 20:38:14.604166 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:14.604166 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 354/704] 10.222.0.57 () {56 vars in 1129 bytes} [Sat Jul 2 20:38:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:38:14.605091 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fad06-b4f8-4787-b261-fa9bd7f947c3 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:14.605091 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fad06-b4f8-4787-b261-fa9bd7f947c3 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:14.605091 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563fad06-b4f8-4787-b261-fa9bd7f947c3 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:14.606595 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 355/705] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:14.606894 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7eee3-9e9b-461b-8797-6c3e11372291 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:14.607209 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7eee3-9e9b-461b-8797-6c3e11372291 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:14.607488 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7eee3-9e9b-461b-8797-6c3e11372291 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:14.608267 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7eee3-9e9b-461b-8797-6c3e11372291 None admin] RBAC: Adding query filter params (type=network) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:14.608583 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7eee3-9e9b-461b-8797-6c3e11372291 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:14.610131 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7eee3-9e9b-461b-8797-6c3e11372291 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:14.612285 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963de22d-7673-4934-8e4e-47a3690c7a40 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:14.612771 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963de22d-7673-4934-8e4e-47a3690c7a40 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:14.613248 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963de22d-7673-4934-8e4e-47a3690c7a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:14.620736 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 351/706] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jul 2 20:38:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:38:14.621537 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7eee3-9e9b-461b-8797-6c3e11372291 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:14.632580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-963de22d-7673-4934-8e4e-47a3690c7a40 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:14.634104 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-963de22d-7673-4934-8e4e-47a3690c7a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:14.688476 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:14.717358 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 356/707] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:14 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Jul 02 20:38:14.718290 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963de22d-7673-4934-8e4e-47a3690c7a40 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:14.743140 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7eee3-9e9b-461b-8797-6c3e11372291 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:14.779213 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8a60c-a463-4b88-a0a9-c72ac4bf5185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:14.779936 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8a60c-a463-4b88-a0a9-c72ac4bf5185 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:14.780220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8a60c-a463-4b88-a0a9-c72ac4bf5185 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:14.780488 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8a60c-a463-4b88-a0a9-c72ac4bf5185 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:14.781352 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8a60c-a463-4b88-a0a9-c72ac4bf5185 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:14.781698 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8a60c-a463-4b88-a0a9-c72ac4bf5185 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:14.783110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8a60c-a463-4b88-a0a9-c72ac4bf5185 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:14.792753 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 352/708] 10.222.0.57 () {56 vars in 1124 bytes} [Sat Jul 2 20:38:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:14.792753 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8a60c-a463-4b88-a0a9-c72ac4bf5185 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:14.825000 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:14.836994 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963de22d-7673-4934-8e4e-47a3690c7a40 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:14.873552 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4243503-5c4e-4864-9e64-dfff65e27d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:14.874184 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4243503-5c4e-4864-9e64-dfff65e27d8b None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:14.874502 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4243503-5c4e-4864-9e64-dfff65e27d8b None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:14.874767 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4243503-5c4e-4864-9e64-dfff65e27d8b None admin] PATH_INFO: `/v3/endpoints` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:14.875728 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4243503-5c4e-4864-9e64-dfff65e27d8b None admin] RBAC: Adding query filter params (interface=public, service_id=c4223a949e4a449492ef08080322d108, region_id=RegionOne) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:14.876040 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4243503-5c4e-4864-9e64-dfff65e27d8b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:14.877416 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4243503-5c4e-4864-9e64-dfff65e27d8b None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:14.882494 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 357/709] 10.222.0.57 () {56 vars in 1251 bytes} [Sat Jul 2 20:38:14 2022] GET /identity/v3/endpoints?service_id=c4223a949e4a449492ef08080322d108&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:14.883289 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4243503-5c4e-4864-9e64-dfff65e27d8b None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:14.898004 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8a60c-a463-4b88-a0a9-c72ac4bf5185 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:14.930662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:14.941492 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990defa-facd-4494-a7f2-cacb664f37df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:14.942294 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990defa-facd-4494-a7f2-cacb664f37df None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:14.942574 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990defa-facd-4494-a7f2-cacb664f37df None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:14.942840 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f990defa-facd-4494-a7f2-cacb664f37df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:14.954081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f990defa-facd-4494-a7f2-cacb664f37df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:38:14.961671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-f990defa-facd-4494-a7f2-cacb664f37df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:38:14.961671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:14.961671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:14.961671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:14.961671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:14.961671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:14.961671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:14.961671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:14.961671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:14.961671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:14.961671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:14.961671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:14.961671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:38:14.961671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:38:14.961671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:38:14.961671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:38:14.962620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:38:14.962620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:38:14.962620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:38:14.962620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:38:14.962620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:14.962620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:14.962620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:14.962620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:14.962620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:14.962620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:14.962620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:14.962620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:14.962620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:14.962620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:14.962620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:14.962620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:14.963517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:14.963517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:14.963517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:14.963517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:14.963517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:38:14.963517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:38:14.963517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:38:14.963517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:38:14.963517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:38:14.963517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:38:14.963517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:38:14.963517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:14.963517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 353/710] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jul 2 20:38:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:14.965089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990defa-facd-4494-a7f2-cacb664f37df None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:14.998005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4243503-5c4e-4864-9e64-dfff65e27d8b None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:15.034776 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243b066-f2ea-4f3d-9ef1-e1910b573103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:15.035488 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243b066-f2ea-4f3d-9ef1-e1910b573103 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:15.035777 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243b066-f2ea-4f3d-9ef1-e1910b573103 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:15.036049 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b243b066-f2ea-4f3d-9ef1-e1910b573103 None admin] PATH_INFO: `/v3/services` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:15.036758 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243b066-f2ea-4f3d-9ef1-e1910b573103 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:15.037063 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243b066-f2ea-4f3d-9ef1-e1910b573103 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:15.038464 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b243b066-f2ea-4f3d-9ef1-e1910b573103 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:15.048171 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 358/711] 10.222.0.57 () {56 vars in 1124 bytes} [Sat Jul 2 20:38:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:15.048171 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243b066-f2ea-4f3d-9ef1-e1910b573103 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:15.068867 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:15.072767 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f990defa-facd-4494-a7f2-cacb664f37df None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:15.108482 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30c8df-28e2-40b6-8cee-b92798b33e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:15.109182 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30c8df-28e2-40b6-8cee-b92798b33e96 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:15.109488 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30c8df-28e2-40b6-8cee-b92798b33e96 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:15.109730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30c8df-28e2-40b6-8cee-b92798b33e96 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:15.110427 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30c8df-28e2-40b6-8cee-b92798b33e96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:15.111872 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30c8df-28e2-40b6-8cee-b92798b33e96 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:15.125534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 354/712] 10.222.0.57 () {56 vars in 1087 bytes} [Sat Jul 2 20:38:14 2022] GET /identity/v3/services => generated 1002 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 20:38:15.126661 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30c8df-28e2-40b6-8cee-b92798b33e96 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:15.160839 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b243b066-f2ea-4f3d-9ef1-e1910b573103 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:15.192955 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:15.204079 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fb52e-3db8-4081-b227-e1531abc44c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:15.204773 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fb52e-3db8-4081-b227-e1531abc44c3 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:15.205049 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fb52e-3db8-4081-b227-e1531abc44c3 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:15.205677 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2fb52e-3db8-4081-b227-e1531abc44c3 None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:15.206458 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fb52e-3db8-4081-b227-e1531abc44c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:15.207293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fb52e-3db8-4081-b227-e1531abc44c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:15.209068 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2fb52e-3db8-4081-b227-e1531abc44c3 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:15.227103 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 359/713] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:38:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:15.230492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fb52e-3db8-4081-b227-e1531abc44c3 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:15.272235 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30c8df-28e2-40b6-8cee-b92798b33e96 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:15.320087 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13d274-425c-49fc-9a1d-adbb85f5f306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:15.322029 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13d274-425c-49fc-9a1d-adbb85f5f306 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:15.322503 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13d274-425c-49fc-9a1d-adbb85f5f306 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:15.322779 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d13d274-425c-49fc-9a1d-adbb85f5f306 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:15.324058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13d274-425c-49fc-9a1d-adbb85f5f306 None admin] RBAC: Adding query filter params (interface=public, service_id=f08c911b2ec0461b99a81954522121e9, region_id=RegionOne) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:15.324369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13d274-425c-49fc-9a1d-adbb85f5f306 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:15.326464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d13d274-425c-49fc-9a1d-adbb85f5f306 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:15.329413 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:15.341005 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 355/714] 10.222.0.57 () {56 vars in 1251 bytes} [Sat Jul 2 20:38:15 2022] GET /identity/v3/endpoints?service_id=f08c911b2ec0461b99a81954522121e9&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:15.342695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13d274-425c-49fc-9a1d-adbb85f5f306 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:15.353062 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2fb52e-3db8-4081-b227-e1531abc44c3 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:15.391974 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd941a-2d56-486c-91b7-dcc835654e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:15.393230 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd941a-2d56-486c-91b7-dcc835654e90 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:15.393713 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd941a-2d56-486c-91b7-dcc835654e90 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:15.394172 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd941a-2d56-486c-91b7-dcc835654e90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:15.405800 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd941a-2d56-486c-91b7-dcc835654e90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:15.407579 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd941a-2d56-486c-91b7-dcc835654e90 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:15.427087 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-6cdd941a-2d56-486c-91b7-dcc835654e90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:15.427087 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:15.427087 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:15.427087 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:15.427087 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:15.427087 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:15.427087 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:15.427087 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:15.427087 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:15.427087 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:15.427087 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:15.427087 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:15.427087 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:38:15.427087 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:38:15.427087 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:38:15.428239 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:38:15.428239 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:15.428239 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:15.428239 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:15.428239 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:15.428239 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:15.428239 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:15.428239 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:15.428239 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:15.428239 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:15.428239 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:15.428239 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:15.428239 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:15.428239 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:15.428239 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:15.428239 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:15.428239 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:15.429311 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:38:15.429311 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:38:15.429311 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:15.429311 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:15.430571 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 360/715] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:15.436168 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd941a-2d56-486c-91b7-dcc835654e90 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:15.492823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d13d274-425c-49fc-9a1d-adbb85f5f306 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:15.508015 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:15.529759 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e175a-042c-4bb1-b5e5-326186a447eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:15.531338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e175a-042c-4bb1-b5e5-326186a447eb None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:15.531338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e175a-042c-4bb1-b5e5-326186a447eb None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:15.531338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e175a-042c-4bb1-b5e5-326186a447eb None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:15.532139 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e175a-042c-4bb1-b5e5-326186a447eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:15.533621 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e175a-042c-4bb1-b5e5-326186a447eb None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:15.543298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 356/716] 10.222.0.57 () {56 vars in 1087 bytes} [Sat Jul 2 20:38:15 2022] GET /identity/v3/services => generated 1002 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 20:38:15.566494 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd941a-2d56-486c-91b7-dcc835654e90 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:15.605737 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9a3e2b-db74-4cbc-b5bf-6c32d784b7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:15.606678 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a3e2b-db74-4cbc-b5bf-6c32d784b7d0 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:15.607127 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a3e2b-db74-4cbc-b5bf-6c32d784b7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:15.607539 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9a3e2b-db74-4cbc-b5bf-6c32d784b7d0 None admin] PATH_INFO: `/v3/domains` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:15.608425 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a3e2b-db74-4cbc-b5bf-6c32d784b7d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:15.609069 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a3e2b-db74-4cbc-b5bf-6c32d784b7d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:15.610873 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9a3e2b-db74-4cbc-b5bf-6c32d784b7d0 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:15.612832 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:15.630145 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 361/717] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:15.631261 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e175a-042c-4bb1-b5e5-326186a447eb None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:15.703141 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c93a68-b817-4201-afa5-63880777b59f None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:15.703864 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c93a68-b817-4201-afa5-63880777b59f None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:15.704332 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c93a68-b817-4201-afa5-63880777b59f None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:15.706254 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 362/718] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:15.714691 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a357c-fda1-43ca-a499-8ab05a4c6d72 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:15.714691 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a357c-fda1-43ca-a499-8ab05a4c6d72 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:15.714691 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a357c-fda1-43ca-a499-8ab05a4c6d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:15.735222 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-8c1a357c-fda1-43ca-a499-8ab05a4c6d72 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:15.737387 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-8c1a357c-fda1-43ca-a499-8ab05a4c6d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:15.754339 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e175a-042c-4bb1-b5e5-326186a447eb None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:15.797637 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa60c1-e920-4d3c-90f4-b8a9142b2ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:15.798460 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa60c1-e920-4d3c-90f4-b8a9142b2ac2 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:15.798797 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa60c1-e920-4d3c-90f4-b8a9142b2ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:15.799108 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa60c1-e920-4d3c-90f4-b8a9142b2ac2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:15.807893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa60c1-e920-4d3c-90f4-b8a9142b2ac2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:15.809377 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa60c1-e920-4d3c-90f4-b8a9142b2ac2 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:15.816931 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 363/719] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:15 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:38:15.828317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-f4aa60c1-e920-4d3c-90f4-b8a9142b2ac2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:38:15.828317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:15.828317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:15.828317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:15.828317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:15.828317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:15.828317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:15.828317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:15.828317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:15.828317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:15.828317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:15.828317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:15.828317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:38:15.828317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:38:15.828317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:38:15.828317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:38:15.829242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:15.829242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:15.829242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:38:15.829242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:38:15.829242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:38:15.829242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:38:15.829242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:15.829242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:15.829242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:15.829242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:15.829242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:15.829242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:15.829242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:15.829242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:15.829242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:15.829242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:15.829242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:15.829242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:15.830153 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:15.830153 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:15.830153 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:38:15.830153 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:38:15.830153 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:38:15.830153 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:38:15.830153 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:38:15.830153 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:38:15.830153 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 02 20:38:15.830153 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:15.830153 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 357/720] 10.222.0.57 () {56 vars in 1093 bytes} [Sat Jul 2 20:38:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:38:15.837082 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a357c-fda1-43ca-a499-8ab05a4c6d72 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:15.844797 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa60c1-e920-4d3c-90f4-b8a9142b2ac2 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:15.895470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:15.973732 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a357c-fda1-43ca-a499-8ab05a4c6d72 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:15.974592 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa60c1-e920-4d3c-90f4-b8a9142b2ac2 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:15.998832 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:16.011389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70343ea3-887e-4911-94a7-9d53e0ffd98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:16.012072 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70343ea3-887e-4911-94a7-9d53e0ffd98d None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:16.012351 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70343ea3-887e-4911-94a7-9d53e0ffd98d None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:16.012623 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70343ea3-887e-4911-94a7-9d53e0ffd98d None admin] PATH_INFO: `/v3/users` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:16.013462 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70343ea3-887e-4911-94a7-9d53e0ffd98d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:16.013771 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70343ea3-887e-4911-94a7-9d53e0ffd98d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:16.015966 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70343ea3-887e-4911-94a7-9d53e0ffd98d None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:16.017246 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717fd31-29dc-4479-8a88-55cafd50e28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:16.018343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717fd31-29dc-4479-8a88-55cafd50e28c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:16.018891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717fd31-29dc-4479-8a88-55cafd50e28c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:16.019386 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717fd31-29dc-4479-8a88-55cafd50e28c None admin] PATH_INFO: `/v3/services/image` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:16.020249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717fd31-29dc-4479-8a88-55cafd50e28c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:16.021811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717fd31-29dc-4479-8a88-55cafd50e28c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:16.038808 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 364/721] 10.222.0.57 () {56 vars in 1133 bytes} [Sat Jul 2 20:38:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:16.039439 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-a717fd31-29dc-4479-8a88-55cafd50e28c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 20:38:16.039439 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:16.039439 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:38:16.039439 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:38:16.039439 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:38:16.039439 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:38:16.039439 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:38:16.039439 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:16.039439 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 20:38:16.039439 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:16.039439 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:38:16.039439 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:16.039439 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:16.039439 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:16.039439 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:16.039439 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:16.039439 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:16.040402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:16.040402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:16.040402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:16.040402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:16.040402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:16.040402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:16.040402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:38:16.040402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:38:16.040402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:38:16.040402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:38:16.040402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:16.040402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:16.040402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:16.040402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:16.040402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:16.040402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:16.041257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:16.041257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:16.041257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:16.041257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:16.041257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:16.041257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:16.041257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:16.041257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:16.041257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:16.041257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:16.041257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:38:16.041257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:16.041257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 02 20:38:16.041257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:16.042483 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70343ea3-887e-4911-94a7-9d53e0ffd98d None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:16.042742 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 358/722] 10.222.0.57 () {56 vars in 1105 bytes} [Sat Jul 2 20:38:15 2022] GET /identity/v3/services/image => generated 86 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:38:16.043996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717fd31-29dc-4479-8a88-55cafd50e28c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:16.148159 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70343ea3-887e-4911-94a7-9d53e0ffd98d None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:16.156720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717fd31-29dc-4479-8a88-55cafd50e28c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:16.158627 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:16.185340 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ee511-1dc2-4cb9-baf1-81cb0c3413f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:16.186038 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ee511-1dc2-4cb9-baf1-81cb0c3413f3 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:16.186274 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ee511-1dc2-4cb9-baf1-81cb0c3413f3 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:16.186548 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9ee511-1dc2-4cb9-baf1-81cb0c3413f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:16.198336 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b4157-3633-4277-8c01-10d20531e6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:16.199473 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b4157-3633-4277-8c01-10d20531e6cd None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:16.200079 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b4157-3633-4277-8c01-10d20531e6cd None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:16.200572 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b4157-3633-4277-8c01-10d20531e6cd None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:16.201532 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b4157-3633-4277-8c01-10d20531e6cd None admin] RBAC: Adding query filter params (name=image) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:16.202135 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b4157-3633-4277-8c01-10d20531e6cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:16.204290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b4157-3633-4277-8c01-10d20531e6cd None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:16.210135 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 359/723] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:38:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:16.215277 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b4157-3633-4277-8c01-10d20531e6cd None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:16.244282 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:16.270149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ee511-1dc2-4cb9-baf1-81cb0c3413f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:16.271673 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9ee511-1dc2-4cb9-baf1-81cb0c3413f3 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:16.328580 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b4157-3633-4277-8c01-10d20531e6cd None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:16.369415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a903e-874b-49db-8ce3-c9f5faa22e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:16.370568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a903e-874b-49db-8ce3-c9f5faa22e12 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:16.371179 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a903e-874b-49db-8ce3-c9f5faa22e12 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:16.371455 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a903e-874b-49db-8ce3-c9f5faa22e12 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:16.372172 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a903e-874b-49db-8ce3-c9f5faa22e12 None admin] RBAC: Adding query filter params (type=image) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:16.372480 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a903e-874b-49db-8ce3-c9f5faa22e12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:16.373935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a903e-874b-49db-8ce3-c9f5faa22e12 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:16.389299 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 360/724] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:38:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:38:16.392096 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 365/725] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:38:16 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 20:38:16.402926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a903e-874b-49db-8ce3-c9f5faa22e12 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:16.403119 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ee511-1dc2-4cb9-baf1-81cb0c3413f3 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:16.439614 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:16.503312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:16.518115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a903e-874b-49db-8ce3-c9f5faa22e12 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:16.527059 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9ee511-1dc2-4cb9-baf1-81cb0c3413f3 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:16.555112 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd74c55-3fc6-4f29-a6e2-6912d047436b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:16.556089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd74c55-3fc6-4f29-a6e2-6912d047436b None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:16.556089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd74c55-3fc6-4f29-a6e2-6912d047436b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:16.556327 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd74c55-3fc6-4f29-a6e2-6912d047436b None admin] PATH_INFO: `/v3/endpoints` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:16.557082 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd74c55-3fc6-4f29-a6e2-6912d047436b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:16.558476 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd74c55-3fc6-4f29-a6e2-6912d047436b None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:16.574064 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87219d-2642-4d6d-9bdb-ebe11f7a2a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:16.575221 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87219d-2642-4d6d-9bdb-ebe11f7a2a63 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:16.575553 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87219d-2642-4d6d-9bdb-ebe11f7a2a63 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:16.575890 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87219d-2642-4d6d-9bdb-ebe11f7a2a63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:16.585382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 361/726] 10.222.0.57 () {60 vars in 1144 bytes} [Sat Jul 2 20:38:16 2022] POST /identity/v3/endpoints => generated 327 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 20:38:16.592117 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da87219d-2642-4d6d-9bdb-ebe11f7a2a63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:16.594666 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da87219d-2642-4d6d-9bdb-ebe11f7a2a63 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:16.616306 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-da87219d-2642-4d6d-9bdb-ebe11f7a2a63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:16.616306 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:16.616306 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:16.616306 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:16.616306 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:16.616306 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:16.616306 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:16.616306 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:16.616306 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:16.616306 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:16.616306 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:16.616306 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:16.616306 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:38:16.616306 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:38:16.616306 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:38:16.617512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:38:16.617512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:16.617512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:16.617512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:16.617512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:16.617512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:16.617512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:16.617512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:16.617512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:16.617512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:16.617512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:16.617512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:16.617512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:16.617512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:16.617512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:16.617512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:16.617512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:16.618413 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:38:16.618413 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:38:16.618413 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:16.618413 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:16.620476 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 366/727] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:16.626676 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd74c55-3fc6-4f29-a6e2-6912d047436b None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:16.728303 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:16.755120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd74c55-3fc6-4f29-a6e2-6912d047436b None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:16.795736 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c35600-a818-4f6e-8529-9de6b652ba60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:16.796503 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c35600-a818-4f6e-8529-9de6b652ba60 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:16.796784 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c35600-a818-4f6e-8529-9de6b652ba60 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:16.797165 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c35600-a818-4f6e-8529-9de6b652ba60 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:16.797904 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c35600-a818-4f6e-8529-9de6b652ba60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:16.798212 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c35600-a818-4f6e-8529-9de6b652ba60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:16.799811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c35600-a818-4f6e-8529-9de6b652ba60 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:16.813032 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 362/728] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:16.818710 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87219d-2642-4d6d-9bdb-ebe11f7a2a63 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:16.922336 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87219d-2642-4d6d-9bdb-ebe11f7a2a63 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:16.956262 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba74c5-c7dc-4bf2-bfeb-c56de3eacfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:16.957102 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba74c5-c7dc-4bf2-bfeb-c56de3eacfc0 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:16.957376 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba74c5-c7dc-4bf2-bfeb-c56de3eacfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:16.957640 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba74c5-c7dc-4bf2-bfeb-c56de3eacfc0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:16.959799 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:16.965780 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba74c5-c7dc-4bf2-bfeb-c56de3eacfc0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:16.967594 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ba74c5-c7dc-4bf2-bfeb-c56de3eacfc0 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:16.982556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-e5ba74c5-c7dc-4bf2-bfeb-c56de3eacfc0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:38:16.982556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:16.982556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:16.982556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:16.982556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:16.982556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:16.982556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:16.982556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:16.982556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:16.982556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:16.982556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:16.982556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:16.982556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:38:16.982556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:38:16.982556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:38:16.983492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:38:16.983492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:16.983492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:16.983492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:16.983492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:16.983492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:16.983492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:16.983492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:16.983492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:16.983492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:16.983492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:16.983492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:16.983492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:16.983492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:16.983492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:16.983492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:16.983492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:16.984438 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:38:16.984438 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:38:16.984438 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:38:16.984438 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:38:16.984438 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:38:16.984438 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:38:16.984438 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:38:16.984438 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:16.984438 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 367/729] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:38:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:16.989916 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c35600-a818-4f6e-8529-9de6b652ba60 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:17.090369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c35600-a818-4f6e-8529-9de6b652ba60 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:17.123782 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf800970-529f-49f7-be6e-6c688b104fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:17.124797 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf800970-529f-49f7-be6e-6c688b104fb6 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:17.125078 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf800970-529f-49f7-be6e-6c688b104fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:17.125352 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf800970-529f-49f7-be6e-6c688b104fb6 None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:17.126137 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf800970-529f-49f7-be6e-6c688b104fb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:17.126609 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf800970-529f-49f7-be6e-6c688b104fb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:17.128214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf800970-529f-49f7-be6e-6c688b104fb6 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:17.150680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 363/730] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jul 2 20:38:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:17.157196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba74c5-c7dc-4bf2-bfeb-c56de3eacfc0 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:17.269772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba74c5-c7dc-4bf2-bfeb-c56de3eacfc0 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:17.308918 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e6babc-ddf4-4d54-bb07-a762446c791d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:17.309602 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6babc-ddf4-4d54-bb07-a762446c791d None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:17.309886 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6babc-ddf4-4d54-bb07-a762446c791d None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:17.310163 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e6babc-ddf4-4d54-bb07-a762446c791d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:17.311039 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6babc-ddf4-4d54-bb07-a762446c791d None admin] RBAC: Adding query filter params (role.id=353a58700c5640988ce2c9012e847cf8, scope.project.id=cd684ec63e1c4d61819302c837dd4349, user.id=eec825336f2e408ebabdcfd29845d5ad) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:17.311351 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6babc-ddf4-4d54-bb07-a762446c791d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:17.312907 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e6babc-ddf4-4d54-bb07-a762446c791d None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:17.320404 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 368/731] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:38:17 2022] GET /identity/v3/role_assignments?user.id=eec825336f2e408ebabdcfd29845d5ad&scope.project.id=cd684ec63e1c4d61819302c837dd4349&role.id=353a58700c5640988ce2c9012e847cf8 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:17.543762 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef67279-2f2f-4e3e-bb5d-a9560aba7928 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:17.544501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef67279-2f2f-4e3e-bb5d-a9560aba7928 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:17.544501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef67279-2f2f-4e3e-bb5d-a9560aba7928 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:17.545996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 364/732] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:17.552823 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927a8f5-850b-4260-aece-8eb36a3e03b0 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:17.553388 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927a8f5-850b-4260-aece-8eb36a3e03b0 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:17.553882 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927a8f5-850b-4260-aece-8eb36a3e03b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:17.571811 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-2927a8f5-850b-4260-aece-8eb36a3e03b0 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:17.573238 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-2927a8f5-850b-4260-aece-8eb36a3e03b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:17.633023 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:17.648269 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 369/733] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:17 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:38:17.672199 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef67279-2f2f-4e3e-bb5d-a9560aba7928 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:17.675477 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:17.796768 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef67279-2f2f-4e3e-bb5d-a9560aba7928 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:17.832228 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0feb229-48d4-4633-a9de-b5cb154962f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:17.833032 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0feb229-48d4-4633-a9de-b5cb154962f0 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:17.833311 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0feb229-48d4-4633-a9de-b5cb154962f0 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:17.833583 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0feb229-48d4-4633-a9de-b5cb154962f0 None admin] PATH_INFO: `/v3/services/network` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:17.834233 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0feb229-48d4-4633-a9de-b5cb154962f0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:17.835635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0feb229-48d4-4633-a9de-b5cb154962f0 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:17.847757 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-a0feb229-48d4-4633-a9de-b5cb154962f0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 20:38:17.847757 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:17.847757 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:38:17.847757 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:38:17.847757 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:38:17.847757 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:38:17.847757 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:38:17.847757 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:17.847757 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 20:38:17.847757 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:17.847757 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:38:17.847757 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:17.847757 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:17.847757 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:17.847757 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:17.847757 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:17.847757 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:17.848804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:17.848804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:17.848804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:17.848804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:17.848804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:17.848804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:17.848804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:38:17.848804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:38:17.848804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:38:17.848804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:38:17.848804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:17.848804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:17.848804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:17.848804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:17.848804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:17.848804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:17.849896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:17.849896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:17.849896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:17.849896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:17.849896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:17.849896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:17.849896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:17.849896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:17.849896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:17.849896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:17.849896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:38:17.849896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:17.849896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 02 20:38:17.849896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:17.849896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 365/734] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:38:17 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:17.857204 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927a8f5-850b-4260-aece-8eb36a3e03b0 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:17.972750 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927a8f5-850b-4260-aece-8eb36a3e03b0 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:18.009341 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bf0a0-a0f2-4442-884c-27c7ebb5da16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:18.010429 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bf0a0-a0f2-4442-884c-27c7ebb5da16 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:18.010942 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bf0a0-a0f2-4442-884c-27c7ebb5da16 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:18.011416 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bf0a0-a0f2-4442-884c-27c7ebb5da16 None admin] PATH_INFO: `/v3/services` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:18.012349 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1bf0a0-a0f2-4442-884c-27c7ebb5da16 None admin] RBAC: Adding query filter params (name=network) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:18.012852 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1bf0a0-a0f2-4442-884c-27c7ebb5da16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:18.014477 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1bf0a0-a0f2-4442-884c-27c7ebb5da16 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:18.024257 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 370/735] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jul 2 20:38:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:18.026077 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bf0a0-a0f2-4442-884c-27c7ebb5da16 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:18.026307 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17805df-f5f4-4cb4-a8f8-1ce43e72f3cd None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:18.026598 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17805df-f5f4-4cb4-a8f8-1ce43e72f3cd None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:18.026873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17805df-f5f4-4cb4-a8f8-1ce43e72f3cd None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:18.028250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 366/736] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:18.033066 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dbf27-5764-4da3-9284-4d0a26218dd0 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:18.033351 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dbf27-5764-4da3-9284-4d0a26218dd0 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:18.033626 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8dbf27-5764-4da3-9284-4d0a26218dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:18.050256 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-fe8dbf27-5764-4da3-9284-4d0a26218dd0 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:18.051411 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-fe8dbf27-5764-4da3-9284-4d0a26218dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:18.085406 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:18.112009 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:18.127175 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 367/737] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:18 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 20:38:18.139133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bf0a0-a0f2-4442-884c-27c7ebb5da16 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:18.144184 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8dbf27-5764-4da3-9284-4d0a26218dd0 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:18.177737 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef3d97-09ff-4a6a-9b8c-45c08feb86df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:18.179227 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef3d97-09ff-4a6a-9b8c-45c08feb86df None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:18.179740 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef3d97-09ff-4a6a-9b8c-45c08feb86df None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:18.180210 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaef3d97-09ff-4a6a-9b8c-45c08feb86df None admin] PATH_INFO: `/v3/services` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:18.181171 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef3d97-09ff-4a6a-9b8c-45c08feb86df None admin] RBAC: Adding query filter params (type=network) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:18.181688 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef3d97-09ff-4a6a-9b8c-45c08feb86df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:18.183438 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaef3d97-09ff-4a6a-9b8c-45c08feb86df None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:18.194148 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 371/738] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jul 2 20:38:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:38:18.195649 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef3d97-09ff-4a6a-9b8c-45c08feb86df None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:18.243634 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8dbf27-5764-4da3-9284-4d0a26218dd0 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:18.278325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5036d3-ec17-48a0-90ff-1900eb347c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:18.278793 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5036d3-ec17-48a0-90ff-1900eb347c93 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:18.279138 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5036d3-ec17-48a0-90ff-1900eb347c93 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:18.279388 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5036d3-ec17-48a0-90ff-1900eb347c93 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:18.280037 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5036d3-ec17-48a0-90ff-1900eb347c93 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:18.281661 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5036d3-ec17-48a0-90ff-1900eb347c93 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:18.294959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-7d5036d3-ec17-48a0-90ff-1900eb347c93 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 20:38:18.294959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:18.294959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:38:18.294959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:38:18.294959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:38:18.294959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:38:18.294959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:38:18.294959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:18.294959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 20:38:18.294959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:18.294959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:38:18.294959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:18.294959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:18.294959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:18.294959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:18.294959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:18.295951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:18.295951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:18.295951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:18.295951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:18.295951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:18.295951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:18.295951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:18.295951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:38:18.295951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:38:18.295951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:38:18.295951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:38:18.295951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:18.295951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:18.295951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:18.295951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:18.295951 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:18.296970 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:18.296970 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:18.296970 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:18.296970 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:18.296970 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:18.296970 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:18.296970 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:18.296970 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:18.296970 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:18.296970 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:18.296970 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:18.296970 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:38:18.296970 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:18.296970 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 02 20:38:18.296970 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:18.301499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 368/739] 10.222.0.57 () {56 vars in 1129 bytes} [Sat Jul 2 20:38:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:38:18.302333 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5036d3-ec17-48a0-90ff-1900eb347c93 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:18.310236 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaef3d97-09ff-4a6a-9b8c-45c08feb86df None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:18.336876 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:18.353807 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd69f5d-e82c-4c54-b077-8bdc238d9bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:18.354848 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd69f5d-e82c-4c54-b077-8bdc238d9bbd None admin] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:18.355482 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd69f5d-e82c-4c54-b077-8bdc238d9bbd None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:18.355987 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd69f5d-e82c-4c54-b077-8bdc238d9bbd None admin] PATH_INFO: `/v3/endpoints` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:18.356966 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd69f5d-e82c-4c54-b077-8bdc238d9bbd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:18.358982 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd69f5d-e82c-4c54-b077-8bdc238d9bbd None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:18.373173 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:18.391646 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 372/740] 10.222.0.57 () {60 vars in 1144 bytes} [Sat Jul 2 20:38:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 20:38:18.419458 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5036d3-ec17-48a0-90ff-1900eb347c93 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:18.463341 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aca408-9d9c-4860-b127-7c16fe17e6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:18.464017 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aca408-9d9c-4860-b127-7c16fe17e6e2 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:18.464305 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aca408-9d9c-4860-b127-7c16fe17e6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:18.464564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aca408-9d9c-4860-b127-7c16fe17e6e2 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:18.465269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aca408-9d9c-4860-b127-7c16fe17e6e2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:18.465570 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aca408-9d9c-4860-b127-7c16fe17e6e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:18.467050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aca408-9d9c-4860-b127-7c16fe17e6e2 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:18.472819 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 369/741] 10.222.0.57 () {56 vars in 1124 bytes} [Sat Jul 2 20:38:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:18.478595 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd69f5d-e82c-4c54-b077-8bdc238d9bbd None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:18.592505 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd69f5d-e82c-4c54-b077-8bdc238d9bbd None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:18.627007 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334e53a8-1196-45ce-bd6c-6709cb0aac5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:18.627729 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e53a8-1196-45ce-bd6c-6709cb0aac5b None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:18.628006 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e53a8-1196-45ce-bd6c-6709cb0aac5b None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:18.628269 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334e53a8-1196-45ce-bd6c-6709cb0aac5b None admin] PATH_INFO: `/v3/services` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:18.628970 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e53a8-1196-45ce-bd6c-6709cb0aac5b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:18.629269 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e53a8-1196-45ce-bd6c-6709cb0aac5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:18.630640 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334e53a8-1196-45ce-bd6c-6709cb0aac5b None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:18.636305 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 373/742] 10.222.0.57 () {56 vars in 1124 bytes} [Sat Jul 2 20:38:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:18.645043 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aca408-9d9c-4860-b127-7c16fe17e6e2 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:18.755323 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aca408-9d9c-4860-b127-7c16fe17e6e2 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:18.776275 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:18.791388 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db311db-0622-4124-a2b7-13267f4e448e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:18.792051 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db311db-0622-4124-a2b7-13267f4e448e None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:18.792328 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db311db-0622-4124-a2b7-13267f4e448e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:18.792596 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db311db-0622-4124-a2b7-13267f4e448e None admin] PATH_INFO: `/v3/endpoints` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:18.793339 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db311db-0622-4124-a2b7-13267f4e448e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:18.794708 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db311db-0622-4124-a2b7-13267f4e448e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:18.822931 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 370/743] 10.222.0.57 () {60 vars in 1144 bytes} [Sat Jul 2 20:38:18 2022] POST /identity/v3/endpoints => generated 346 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 20:38:19.145498 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11384689-cf23-4173-b44c-ae809917b847 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:19.145928 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11384689-cf23-4173-b44c-ae809917b847 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:19.146047 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11384689-cf23-4173-b44c-ae809917b847 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:19.147669 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 374/744] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:19.152727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5407c-2f41-4488-93ff-89b4a5870964 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:19.153035 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5407c-2f41-4488-93ff-89b4a5870964 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:19.153315 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5407c-2f41-4488-93ff-89b4a5870964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:19.172106 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-b6e5407c-2f41-4488-93ff-89b4a5870964 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:19.173326 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-b6e5407c-2f41-4488-93ff-89b4a5870964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:19.254185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 371/745] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:19 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:38:19.289983 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11384689-cf23-4173-b44c-ae809917b847 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:19.334124 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:19.406179 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11384689-cf23-4173-b44c-ae809917b847 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:19.439258 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda21a6-fc1b-42ed-8c8a-e6605f170c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:19.439984 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda21a6-fc1b-42ed-8c8a-e6605f170c7e None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:19.440272 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda21a6-fc1b-42ed-8c8a-e6605f170c7e None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:19.440545 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda21a6-fc1b-42ed-8c8a-e6605f170c7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:19.512222 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda21a6-fc1b-42ed-8c8a-e6605f170c7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:19.513718 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda21a6-fc1b-42ed-8c8a-e6605f170c7e None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:19.549501 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:19.618154 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 375/746] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:38:19 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 20:38:19.623990 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5407c-2f41-4488-93ff-89b4a5870964 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:19.739158 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36e877-ef63-438a-b6ab-b82a74f54fb8 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:19.739528 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36e877-ef63-438a-b6ab-b82a74f54fb8 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:19.739815 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f36e877-ef63-438a-b6ab-b82a74f54fb8 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:19.740261 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5407c-2f41-4488-93ff-89b4a5870964 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:19.741586 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 376/747] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:38:19.741878 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:19.746670 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd9057-0151-426f-b7e7-58f42ec07dbf None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:19.746995 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd9057-0151-426f-b7e7-58f42ec07dbf None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:19.747300 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fd9057-0151-426f-b7e7-58f42ec07dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:19.765005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-d4fd9057-0151-426f-b7e7-58f42ec07dbf None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:19.766223 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-d4fd9057-0151-426f-b7e7-58f42ec07dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:19.780048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8b869-6236-4a70-a6e6-88d099e0100b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:19.780928 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8b869-6236-4a70-a6e6-88d099e0100b None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:19.781217 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8b869-6236-4a70-a6e6-88d099e0100b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:19.781491 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8b869-6236-4a70-a6e6-88d099e0100b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:19.792202 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8b869-6236-4a70-a6e6-88d099e0100b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:19.793662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8b869-6236-4a70-a6e6-88d099e0100b None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:19.812803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-61e8b869-6236-4a70-a6e6-88d099e0100b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:19.812803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:19.812803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:19.812803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:19.812803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:19.812803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:19.812803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:19.812803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:19.812803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:19.812803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:19.812803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:19.812803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:19.812803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:38:19.812803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:38:19.812803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:38:19.813727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:38:19.813727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:19.813727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:19.813727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:19.813727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:19.813727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:19.813727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:19.813727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:19.813727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:19.813727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:19.813727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:19.813727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:19.813727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:19.813727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:19.813727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:19.813727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:19.813727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:19.814621 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:38:19.814621 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:38:19.814621 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:38:19.814621 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:19.814621 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 372/748] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:19.819781 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8b869-6236-4a70-a6e6-88d099e0100b None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:19.841962 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 377/749] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:19 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:38:19.865475 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd9057-0151-426f-b7e7-58f42ec07dbf None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:19.931289 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8b869-6236-4a70-a6e6-88d099e0100b None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:19.933461 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:19.965815 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde37945-48c8-47e4-8988-93286182f321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:19.966398 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde37945-48c8-47e4-8988-93286182f321 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:19.966684 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde37945-48c8-47e4-8988-93286182f321 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:19.966988 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde37945-48c8-47e4-8988-93286182f321 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:19.967711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde37945-48c8-47e4-8988-93286182f321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:19.968049 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde37945-48c8-47e4-8988-93286182f321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:19.969444 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde37945-48c8-47e4-8988-93286182f321 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:19.974607 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fd9057-0151-426f-b7e7-58f42ec07dbf None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:19.981139 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 373/750] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:38:20.015081 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f756891-1991-49b2-9cc6-eed9197e2196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:20.015925 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f756891-1991-49b2-9cc6-eed9197e2196 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:20.016205 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f756891-1991-49b2-9cc6-eed9197e2196 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:20.016450 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f756891-1991-49b2-9cc6-eed9197e2196 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:20.017142 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f756891-1991-49b2-9cc6-eed9197e2196 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:20.018662 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f756891-1991-49b2-9cc6-eed9197e2196 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:20.033075 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-0f756891-1991-49b2-9cc6-eed9197e2196 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 20:38:20.033075 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:20.033075 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:38:20.033075 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:38:20.033075 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:38:20.033075 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:38:20.033075 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:38:20.033075 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:20.033075 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 20:38:20.033075 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:20.033075 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:38:20.033075 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:20.033075 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:20.033075 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:20.033075 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:20.033075 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:20.034103 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:20.034103 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:20.034103 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:20.034103 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:20.034103 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:20.034103 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:20.034103 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:20.034103 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:38:20.034103 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:38:20.034103 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:38:20.034103 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:38:20.034103 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:20.034103 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:20.034103 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:20.034103 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:20.034103 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:20.040265 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:20.040265 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:20.040265 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:20.040265 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:20.040265 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:20.040265 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:20.040265 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:20.040265 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:20.040265 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:20.040265 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:20.040265 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:20.040265 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:38:20.040265 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:20.040265 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 20:38:20.040265 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:20.040265 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 378/751] 10.222.0.57 () {56 vars in 1132 bytes} [Sat Jul 2 20:38:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:38:20.042941 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde37945-48c8-47e4-8988-93286182f321 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:20.061863 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:20.159627 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde37945-48c8-47e4-8988-93286182f321 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:20.197838 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921d1d6-608a-4da7-8256-cf16c98b5e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:20.198521 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921d1d6-608a-4da7-8256-cf16c98b5e77 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:20.198805 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921d1d6-608a-4da7-8256-cf16c98b5e77 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:20.199125 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921d1d6-608a-4da7-8256-cf16c98b5e77 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:20.199841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3921d1d6-608a-4da7-8256-cf16c98b5e77 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:20.200156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3921d1d6-608a-4da7-8256-cf16c98b5e77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:20.201557 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3921d1d6-608a-4da7-8256-cf16c98b5e77 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:20.207102 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 374/752] 10.222.0.57 () {56 vars in 1126 bytes} [Sat Jul 2 20:38:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:38:20.212652 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f756891-1991-49b2-9cc6-eed9197e2196 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:20.322600 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f756891-1991-49b2-9cc6-eed9197e2196 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:20.350329 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:20.356452 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4331cf-cd77-4493-bf18-1cc1c521d584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:20.357114 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4331cf-cd77-4493-bf18-1cc1c521d584 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:20.357389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4331cf-cd77-4493-bf18-1cc1c521d584 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:20.357653 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4331cf-cd77-4493-bf18-1cc1c521d584 None admin] PATH_INFO: `/v3/services` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:20.358347 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4331cf-cd77-4493-bf18-1cc1c521d584 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:20.358732 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4331cf-cd77-4493-bf18-1cc1c521d584 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:20.360137 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4331cf-cd77-4493-bf18-1cc1c521d584 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:20.364687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 379/753] 10.222.0.57 () {56 vars in 1126 bytes} [Sat Jul 2 20:38:20 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:21.257903 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c7397-d34a-47df-aaa3-e0707c58055c None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:21.258525 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c7397-d34a-47df-aaa3-e0707c58055c None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:21.258525 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c7397-d34a-47df-aaa3-e0707c58055c None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:21.259793 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 375/754] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:21.265684 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b9af7-3abe-420e-9999-a4b237d6d387 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:21.265968 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b9af7-3abe-420e-9999-a4b237d6d387 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:21.266242 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b9af7-3abe-420e-9999-a4b237d6d387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:21.284058 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-259b9af7-3abe-420e-9999-a4b237d6d387 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:21.285251 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-259b9af7-3abe-420e-9999-a4b237d6d387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:21.356969 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 380/755] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:21 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:38:21.380986 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c7397-d34a-47df-aaa3-e0707c58055c None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:21.462281 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:21.488251 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c7397-d34a-47df-aaa3-e0707c58055c None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:21.526134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a600d-c6c9-47d1-91f2-31a18cdb36b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:21.526852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a600d-c6c9-47d1-91f2-31a18cdb36b7 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:21.527162 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a600d-c6c9-47d1-91f2-31a18cdb36b7 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:21.527438 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7a600d-c6c9-47d1-91f2-31a18cdb36b7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:21.528085 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a600d-c6c9-47d1-91f2-31a18cdb36b7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:21.529469 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7a600d-c6c9-47d1-91f2-31a18cdb36b7 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:21.541511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-1e7a600d-c6c9-47d1-91f2-31a18cdb36b7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 20:38:21.541511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:21.541511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:38:21.541511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:38:21.541511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:38:21.541511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:38:21.541511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:38:21.541511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:21.541511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 20:38:21.541511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:21.541511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:38:21.541511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:21.541511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:21.541511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:21.541511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:21.541511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:21.541511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:21.542673 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:21.542673 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:21.542673 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:21.542673 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:21.542673 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:21.542673 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:21.542673 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:38:21.542673 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:38:21.542673 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:38:21.542673 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:38:21.542673 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:21.542673 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:21.542673 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:21.542673 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:21.542673 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:21.542673 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:21.543719 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:21.543719 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:21.543719 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:21.543719 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:21.543719 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:21.543719 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:21.543719 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:21.543719 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:21.543719 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:21.543719 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:21.543719 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:38:21.543719 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:21.543719 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 20:38:21.543719 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:21.547462 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 376/756] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jul 2 20:38:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:21.549012 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b9af7-3abe-420e-9999-a4b237d6d387 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:21.649444 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b9af7-3abe-420e-9999-a4b237d6d387 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:21.672921 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:21.684668 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbac931-f6ca-45e9-9da8-ee3a3d65f64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:21.685325 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbac931-f6ca-45e9-9da8-ee3a3d65f64a None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:21.685600 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbac931-f6ca-45e9-9da8-ee3a3d65f64a None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:21.685868 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbac931-f6ca-45e9-9da8-ee3a3d65f64a None admin] PATH_INFO: `/v3/services` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:21.686558 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbac931-f6ca-45e9-9da8-ee3a3d65f64a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:21.686869 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbac931-f6ca-45e9-9da8-ee3a3d65f64a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:21.688264 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbac931-f6ca-45e9-9da8-ee3a3d65f64a None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:21.692799 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 381/757] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jul 2 20:38:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:21.698664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a600d-c6c9-47d1-91f2-31a18cdb36b7 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:21.802891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7a600d-c6c9-47d1-91f2-31a18cdb36b7 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:21.837961 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e688c-5391-4876-931a-be308bec6203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:21.838630 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e688c-5391-4876-931a-be308bec6203 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:21.838946 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e688c-5391-4876-931a-be308bec6203 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:21.839224 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e688c-5391-4876-931a-be308bec6203 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:21.839901 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e688c-5391-4876-931a-be308bec6203 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:21.840232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e688c-5391-4876-931a-be308bec6203 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:21.841613 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e688c-5391-4876-931a-be308bec6203 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:21.846837 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 377/758] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jul 2 20:38:21 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:22.634356 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4ee04-de0d-4ac8-90bf-9f1350c4968c None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:22.634931 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4ee04-de0d-4ac8-90bf-9f1350c4968c None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:22.634931 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4ee04-de0d-4ac8-90bf-9f1350c4968c None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:22.636305 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 382/759] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:22.641628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cfad8-6de0-4ed3-8433-ce5772f12040 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:22.642061 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cfad8-6de0-4ed3-8433-ce5772f12040 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:22.642146 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31cfad8-6de0-4ed3-8433-ce5772f12040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:22.654064 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:22.659682 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-c31cfad8-6de0-4ed3-8433-ce5772f12040 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:22.661068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-c31cfad8-6de0-4ed3-8433-ce5772f12040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:22.729933 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 378/760] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:22 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:38:22.753896 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4ee04-de0d-4ac8-90bf-9f1350c4968c None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:22.858814 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4ee04-de0d-4ac8-90bf-9f1350c4968c None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:22.893513 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed26db-f9e8-4414-8d0b-7f47ba491f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:22.894085 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed26db-f9e8-4414-8d0b-7f47ba491f1c None admin] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:22.894360 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed26db-f9e8-4414-8d0b-7f47ba491f1c None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:22.894629 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed26db-f9e8-4414-8d0b-7f47ba491f1c None admin] PATH_INFO: `/v3/services` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:22.895376 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed26db-f9e8-4414-8d0b-7f47ba491f1c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:22.896736 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed26db-f9e8-4414-8d0b-7f47ba491f1c None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:22.912675 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 383/761] 10.222.0.57 () {60 vars in 1141 bytes} [Sat Jul 2 20:38:22 2022] POST /identity/v3/services => generated 269 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:38:24.101812 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0194f-6765-4be3-ae77-365eadf7b0d5 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:24.102401 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0194f-6765-4be3-ae77-365eadf7b0d5 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:24.102401 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e0194f-6765-4be3-ae77-365eadf7b0d5 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:24.103909 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 379/762] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:24.108970 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ace70-b48e-4d3a-8cf2-68a0ac2c8f7f None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:24.109389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ace70-b48e-4d3a-8cf2-68a0ac2c8f7f None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:24.109729 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ace70-b48e-4d3a-8cf2-68a0ac2c8f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:24.127348 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-d82ace70-b48e-4d3a-8cf2-68a0ac2c8f7f None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:24.128521 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-d82ace70-b48e-4d3a-8cf2-68a0ac2c8f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:24.173444 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:24.205143 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 384/763] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:24 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:38:24.228977 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0194f-6765-4be3-ae77-365eadf7b0d5 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:24.331562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e0194f-6765-4be3-ae77-365eadf7b0d5 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:24.365796 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7afd40-7099-4a5f-a53b-c62810fdcabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:24.366375 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7afd40-7099-4a5f-a53b-c62810fdcabe None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:24.366651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7afd40-7099-4a5f-a53b-c62810fdcabe None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:24.366934 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7afd40-7099-4a5f-a53b-c62810fdcabe None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:24.367653 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7afd40-7099-4a5f-a53b-c62810fdcabe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:24.369020 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7afd40-7099-4a5f-a53b-c62810fdcabe None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:24.372061 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:24.391270 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 380/764] 10.222.0.57 () {60 vars in 1141 bytes} [Sat Jul 2 20:38:24 2022] POST /identity/v3/services => generated 251 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:38:25.203635 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c85823-a071-493e-8f1b-d8068c3099a2 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:25.204183 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c85823-a071-493e-8f1b-d8068c3099a2 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:25.204183 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c85823-a071-493e-8f1b-d8068c3099a2 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:25.205543 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 385/765] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:25.210950 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c15d4-574e-4d04-99c3-11c084a642e9 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:25.211377 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c15d4-574e-4d04-99c3-11c084a642e9 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:25.211493 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c15d4-574e-4d04-99c3-11c084a642e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:25.229178 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-db3c15d4-574e-4d04-99c3-11c084a642e9 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:25.230489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-db3c15d4-574e-4d04-99c3-11c084a642e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:25.308035 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 381/766] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:25 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:38:25.335132 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c85823-a071-493e-8f1b-d8068c3099a2 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:25.449252 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c85823-a071-493e-8f1b-d8068c3099a2 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:25.485188 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5198d9e-2f3a-4303-b36c-c98eae5ae323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:25.485928 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5198d9e-2f3a-4303-b36c-c98eae5ae323 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:25.486210 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5198d9e-2f3a-4303-b36c-c98eae5ae323 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:25.486544 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5198d9e-2f3a-4303-b36c-c98eae5ae323 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:25.487217 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5198d9e-2f3a-4303-b36c-c98eae5ae323 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:25.488624 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5198d9e-2f3a-4303-b36c-c98eae5ae323 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:25.501096 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-a5198d9e-2f3a-4303-b36c-c98eae5ae323 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 20:38:25.501096 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:25.501096 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:38:25.501096 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:38:25.501096 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:38:25.501096 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:38:25.501096 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:38:25.501096 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:25.501096 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 20:38:25.501096 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:25.501096 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:38:25.501096 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:25.501096 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:25.501096 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:25.501096 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:25.501096 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:25.502136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:25.502136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:25.502136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:25.502136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:25.502136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:25.502136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:25.502136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:25.502136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:38:25.502136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:38:25.502136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:38:25.502136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:38:25.502136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:25.502136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:25.502136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:25.502136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:25.502136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:25.503481 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:25.503481 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:25.503481 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:25.503481 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:25.503481 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:25.503481 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:25.503481 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:25.503481 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:25.503481 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:25.503481 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:25.503481 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:25.503481 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:38:25.503481 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:25.503481 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 20:38:25.503481 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:25.503481 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 386/767] 10.222.0.57 () {56 vars in 1132 bytes} [Sat Jul 2 20:38:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:25.508335 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c15d4-574e-4d04-99c3-11c084a642e9 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:25.615727 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3c15d4-574e-4d04-99c3-11c084a642e9 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:25.638796 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:25.650815 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70860d34-0a65-4335-85e8-0fb911922530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:25.651528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70860d34-0a65-4335-85e8-0fb911922530 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:25.651804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70860d34-0a65-4335-85e8-0fb911922530 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:25.652073 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70860d34-0a65-4335-85e8-0fb911922530 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:25.652772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70860d34-0a65-4335-85e8-0fb911922530 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:25.653063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70860d34-0a65-4335-85e8-0fb911922530 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:25.654444 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70860d34-0a65-4335-85e8-0fb911922530 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:25.659779 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 382/768] 10.222.0.57 () {56 vars in 1126 bytes} [Sat Jul 2 20:38:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:25.665607 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5198d9e-2f3a-4303-b36c-c98eae5ae323 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:25.712891 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:25.775226 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5198d9e-2f3a-4303-b36c-c98eae5ae323 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:25.809023 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc45e10-cc29-4086-9197-a6d3f4857f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:25.809652 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc45e10-cc29-4086-9197-a6d3f4857f4e None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:25.809928 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc45e10-cc29-4086-9197-a6d3f4857f4e None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:25.810198 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc45e10-cc29-4086-9197-a6d3f4857f4e None admin] PATH_INFO: `/v3/services` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:25.810894 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc45e10-cc29-4086-9197-a6d3f4857f4e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:25.811224 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc45e10-cc29-4086-9197-a6d3f4857f4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:25.812636 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc45e10-cc29-4086-9197-a6d3f4857f4e None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:25.817474 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 387/769] 10.222.0.57 () {56 vars in 1126 bytes} [Sat Jul 2 20:38:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:25.823503 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70860d34-0a65-4335-85e8-0fb911922530 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:25.924169 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70860d34-0a65-4335-85e8-0fb911922530 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:25.959186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469b7c3-c6fa-46e6-85c8-ca079f1820af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:25.959856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469b7c3-c6fa-46e6-85c8-ca079f1820af None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:25.960133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469b7c3-c6fa-46e6-85c8-ca079f1820af None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:25.960401 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469b7c3-c6fa-46e6-85c8-ca079f1820af None admin] PATH_INFO: `/v3/endpoints` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:25.961188 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469b7c3-c6fa-46e6-85c8-ca079f1820af None admin] RBAC: Adding query filter params (interface=public, service_id=c0e024dfc9d1437b8ad729213bef6501, region_id=RegionOne) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:25.961495 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469b7c3-c6fa-46e6-85c8-ca079f1820af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:25.962874 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469b7c3-c6fa-46e6-85c8-ca079f1820af None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:25.968695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 383/770] 10.222.0.57 () {56 vars in 1251 bytes} [Sat Jul 2 20:38:25 2022] GET /identity/v3/endpoints?service_id=c0e024dfc9d1437b8ad729213bef6501&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:25.974337 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc45e10-cc29-4086-9197-a6d3f4857f4e None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:26.079806 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc45e10-cc29-4086-9197-a6d3f4857f4e None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:26.081342 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:26.113805 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f502056-9734-4926-bdf0-b7a6bd67793c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:26.114463 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f502056-9734-4926-bdf0-b7a6bd67793c None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:26.114739 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f502056-9734-4926-bdf0-b7a6bd67793c None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:26.115044 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f502056-9734-4926-bdf0-b7a6bd67793c None admin] PATH_INFO: `/v3/services` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:26.115711 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f502056-9734-4926-bdf0-b7a6bd67793c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:26.117080 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f502056-9734-4926-bdf0-b7a6bd67793c None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:26.123062 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 388/771] 10.222.0.57 () {56 vars in 1087 bytes} [Sat Jul 2 20:38:25 2022] GET /identity/v3/services => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 20:38:26.672004 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf0705-8c93-4069-93d7-509fec223a5f None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:26.672592 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf0705-8c93-4069-93d7-509fec223a5f None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:26.672592 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf0705-8c93-4069-93d7-509fec223a5f None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:26.673917 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 384/772] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:26.679312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0fac1-fd4b-4c05-a803-0e1242d16cc8 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:26.679747 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0fac1-fd4b-4c05-a803-0e1242d16cc8 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:26.680014 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd0fac1-fd4b-4c05-a803-0e1242d16cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:26.698152 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-7dd0fac1-fd4b-4c05-a803-0e1242d16cc8 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:26.699366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-7dd0fac1-fd4b-4c05-a803-0e1242d16cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:26.773307 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 389/773] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:26 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:38:26.797275 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf0705-8c93-4069-93d7-509fec223a5f None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:26.853764 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:26.912270 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf0705-8c93-4069-93d7-509fec223a5f None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:26.952706 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a78400-0f71-41f3-aeb8-55db145ac1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:26.953459 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a78400-0f71-41f3-aeb8-55db145ac1af None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:26.953737 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a78400-0f71-41f3-aeb8-55db145ac1af None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:26.954105 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a78400-0f71-41f3-aeb8-55db145ac1af None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:26.955325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a78400-0f71-41f3-aeb8-55db145ac1af None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:26.956969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a78400-0f71-41f3-aeb8-55db145ac1af None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:26.970185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-82a78400-0f71-41f3-aeb8-55db145ac1af None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 20:38:26.970185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:26.970185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:38:26.970185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:38:26.970185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:38:26.970185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:38:26.970185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:38:26.970185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:26.970185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 20:38:26.970185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:26.970185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:38:26.970185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:26.970185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:26.970185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:26.970185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:26.970185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:26.970185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:26.971366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:26.971366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:26.971366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:26.971366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:26.971366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:26.971366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:26.971366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:38:26.971366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:38:26.971366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:38:26.971366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:38:26.971366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:26.971366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:26.971366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:26.971366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:26.971366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:26.971366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:26.972269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:26.972269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:26.972269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:26.972269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:26.972269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:26.972269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:26.972269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:26.972269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:26.972269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:26.972269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:26.972269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:38:26.972269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:26.972269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 20:38:26.972269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:26.975091 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 385/774] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jul 2 20:38:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:26.978095 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0fac1-fd4b-4c05-a803-0e1242d16cc8 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:27.081508 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:27.088231 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd0fac1-fd4b-4c05-a803-0e1242d16cc8 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:27.130171 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7e591-5062-40a9-99eb-5fd134fb34d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:27.130853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7e591-5062-40a9-99eb-5fd134fb34d2 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:27.131162 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7e591-5062-40a9-99eb-5fd134fb34d2 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:27.131439 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7e591-5062-40a9-99eb-5fd134fb34d2 None admin] PATH_INFO: `/v3/services` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:27.132131 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7e591-5062-40a9-99eb-5fd134fb34d2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:27.132414 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7e591-5062-40a9-99eb-5fd134fb34d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:27.133786 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba7e591-5062-40a9-99eb-5fd134fb34d2 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:27.139385 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 390/775] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jul 2 20:38:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:27.146566 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a78400-0f71-41f3-aeb8-55db145ac1af None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:27.257442 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a78400-0f71-41f3-aeb8-55db145ac1af None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:27.273619 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:27.295147 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae01c4-6d87-4a92-bdb8-8e4c13d192f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:27.296457 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae01c4-6d87-4a92-bdb8-8e4c13d192f6 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:27.296826 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae01c4-6d87-4a92-bdb8-8e4c13d192f6 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:27.297104 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ae01c4-6d87-4a92-bdb8-8e4c13d192f6 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:27.297838 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae01c4-6d87-4a92-bdb8-8e4c13d192f6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:27.298143 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae01c4-6d87-4a92-bdb8-8e4c13d192f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:27.299610 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ae01c4-6d87-4a92-bdb8-8e4c13d192f6 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:27.306049 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 386/776] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jul 2 20:38:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:27.312482 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7e591-5062-40a9-99eb-5fd134fb34d2 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:27.434864 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7e591-5062-40a9-99eb-5fd134fb34d2 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:27.475638 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e49e0e-15bf-410c-ae99-8d9384691b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:27.476310 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e49e0e-15bf-410c-ae99-8d9384691b62 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:27.476597 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e49e0e-15bf-410c-ae99-8d9384691b62 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:27.476873 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e49e0e-15bf-410c-ae99-8d9384691b62 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:27.477661 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e49e0e-15bf-410c-ae99-8d9384691b62 None admin] RBAC: Adding query filter params (interface=public, service_id=df4be11fe4694283b29cd5a5d909ad6a, region_id=RegionOne) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:27.477973 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e49e0e-15bf-410c-ae99-8d9384691b62 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:27.479401 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e49e0e-15bf-410c-ae99-8d9384691b62 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:27.484859 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 391/777] 10.222.0.57 () {56 vars in 1251 bytes} [Sat Jul 2 20:38:27 2022] GET /identity/v3/endpoints?service_id=df4be11fe4694283b29cd5a5d909ad6a&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:27.491230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae01c4-6d87-4a92-bdb8-8e4c13d192f6 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:27.616447 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ae01c4-6d87-4a92-bdb8-8e4c13d192f6 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:27.653884 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41b662-df95-436c-9678-2a24bc3386fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:27.654562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41b662-df95-436c-9678-2a24bc3386fa None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:27.654847 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41b662-df95-436c-9678-2a24bc3386fa None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:27.655206 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41b662-df95-436c-9678-2a24bc3386fa None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:27.656498 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41b662-df95-436c-9678-2a24bc3386fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:27.658122 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41b662-df95-436c-9678-2a24bc3386fa None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:27.665403 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 387/778] 10.222.0.57 () {56 vars in 1087 bytes} [Sat Jul 2 20:38:27 2022] GET /identity/v3/services => generated 1498 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 20:38:28.486057 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e2fe4-6132-4153-9544-4f2547fc3711 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:28.486634 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e2fe4-6132-4153-9544-4f2547fc3711 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:28.486634 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e2fe4-6132-4153-9544-4f2547fc3711 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:28.487993 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 392/779] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:28.493404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba0e87-1ccd-472a-b335-bc3a41ec06a2 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:28.493794 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba0e87-1ccd-472a-b335-bc3a41ec06a2 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:28.493985 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba0e87-1ccd-472a-b335-bc3a41ec06a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:28.511502 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-7bba0e87-1ccd-472a-b335-bc3a41ec06a2 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:28.512697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-7bba0e87-1ccd-472a-b335-bc3a41ec06a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:28.550334 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:28.583939 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 388/780] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:28 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:38:28.608076 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e2fe4-6132-4153-9544-4f2547fc3711 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:28.633867 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:28.711616 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e2fe4-6132-4153-9544-4f2547fc3711 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:28.744793 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf9fcf-35d2-4a61-b16b-a8d738eecadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:28.745526 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf9fcf-35d2-4a61-b16b-a8d738eecadc None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:28.745801 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf9fcf-35d2-4a61-b16b-a8d738eecadc None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:28.746069 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf9fcf-35d2-4a61-b16b-a8d738eecadc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:28.746708 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf9fcf-35d2-4a61-b16b-a8d738eecadc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:28.748120 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf9fcf-35d2-4a61-b16b-a8d738eecadc None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:28.760725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-6abf9fcf-35d2-4a61-b16b-a8d738eecadc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 20:38:28.760725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:28.760725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:38:28.760725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:38:28.760725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:38:28.760725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:38:28.760725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:38:28.760725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:28.760725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 20:38:28.760725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:28.760725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:38:28.760725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:28.760725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:28.760725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:28.760725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:28.760725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:28.761687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:28.761687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:28.761687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:28.761687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:28.761687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:28.761687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:28.761687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:28.761687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:38:28.761687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:38:28.761687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:38:28.761687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:38:28.761687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:28.761687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:28.761687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:28.761687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:28.761687 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:28.762757 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:28.762757 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:28.762757 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:28.762757 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:28.762757 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:28.762757 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:28.762757 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:28.762757 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:28.762757 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:28.762757 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:28.762757 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:28.762757 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:38:28.762757 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:28.762757 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 02 20:38:28.762757 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:28.762757 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 393/781] 10.222.0.57 () {56 vars in 1132 bytes} [Sat Jul 2 20:38:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:28.768080 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba0e87-1ccd-472a-b335-bc3a41ec06a2 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:28.870162 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba0e87-1ccd-472a-b335-bc3a41ec06a2 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:28.904870 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8570ba8-fe06-439e-8f03-f1ec372dc5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:28.905594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8570ba8-fe06-439e-8f03-f1ec372dc5cd None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:28.905870 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8570ba8-fe06-439e-8f03-f1ec372dc5cd None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:28.906139 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8570ba8-fe06-439e-8f03-f1ec372dc5cd None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:28.906839 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8570ba8-fe06-439e-8f03-f1ec372dc5cd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:28.907169 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8570ba8-fe06-439e-8f03-f1ec372dc5cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:28.908526 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8570ba8-fe06-439e-8f03-f1ec372dc5cd None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:28.913335 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 389/782] 10.222.0.57 () {56 vars in 1126 bytes} [Sat Jul 2 20:38:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:28.919173 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf9fcf-35d2-4a61-b16b-a8d738eecadc None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:29.007214 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:29.020234 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf9fcf-35d2-4a61-b16b-a8d738eecadc None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:29.054568 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f5a50d-27bc-40ad-a615-2eae736ddafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:29.055259 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5a50d-27bc-40ad-a615-2eae736ddafb None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:29.055538 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5a50d-27bc-40ad-a615-2eae736ddafb None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:29.055815 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f5a50d-27bc-40ad-a615-2eae736ddafb None admin] PATH_INFO: `/v3/services` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:29.056511 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5a50d-27bc-40ad-a615-2eae736ddafb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:29.056813 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5a50d-27bc-40ad-a615-2eae736ddafb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:29.058206 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f5a50d-27bc-40ad-a615-2eae736ddafb None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:29.063220 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 394/783] 10.222.0.57 () {56 vars in 1126 bytes} [Sat Jul 2 20:38:28 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:29.068980 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8570ba8-fe06-439e-8f03-f1ec372dc5cd None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:29.105114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:29.170050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8570ba8-fe06-439e-8f03-f1ec372dc5cd None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:29.205247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a247df6-9939-4618-83cc-440d4658c614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:29.205901 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a247df6-9939-4618-83cc-440d4658c614 None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:29.206177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a247df6-9939-4618-83cc-440d4658c614 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:29.206441 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a247df6-9939-4618-83cc-440d4658c614 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:29.207208 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a247df6-9939-4618-83cc-440d4658c614 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:29.208590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a247df6-9939-4618-83cc-440d4658c614 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:29.228619 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 390/784] 10.222.0.57 () {60 vars in 1144 bytes} [Sat Jul 2 20:38:29 2022] POST /identity/v3/endpoints => generated 347 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:38:29.972706 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe67687-5946-4fa8-b939-a4392dec1f1c None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:29.973246 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe67687-5946-4fa8-b939-a4392dec1f1c None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:29.973246 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe67687-5946-4fa8-b939-a4392dec1f1c None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:29.974487 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 395/785] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:29.980063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fdb0e-36f8-412d-b4a2-a643f884bd1d None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:29.980472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fdb0e-36f8-412d-b4a2-a643f884bd1d None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:29.980660 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fdb0e-36f8-412d-b4a2-a643f884bd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:29.999375 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-4d6fdb0e-36f8-412d-b4a2-a643f884bd1d None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:30.000590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-4d6fdb0e-36f8-412d-b4a2-a643f884bd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:30.080236 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 391/786] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:29 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:38:30.104135 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe67687-5946-4fa8-b939-a4392dec1f1c None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:30.212623 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe67687-5946-4fa8-b939-a4392dec1f1c None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:30.248032 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd91251-5e12-4186-ac15-3b8ca977aabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:30.248749 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd91251-5e12-4186-ac15-3b8ca977aabe None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:30.249198 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd91251-5e12-4186-ac15-3b8ca977aabe None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:30.249630 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd91251-5e12-4186-ac15-3b8ca977aabe None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:30.250294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd91251-5e12-4186-ac15-3b8ca977aabe None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:30.251710 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd91251-5e12-4186-ac15-3b8ca977aabe None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:30.263720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-4cd91251-5e12-4186-ac15-3b8ca977aabe None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 20:38:30.263720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:30.263720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:38:30.263720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:38:30.263720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:38:30.263720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:38:30.263720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:38:30.263720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:30.263720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 20:38:30.263720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:30.263720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:38:30.263720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:30.263720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:30.263720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:30.263720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:30.263720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:30.263720 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:30.264961 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:30.264961 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:30.264961 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:30.264961 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:30.264961 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:30.264961 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:30.264961 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:38:30.264961 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:38:30.264961 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:38:30.264961 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:38:30.264961 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:30.264961 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:30.264961 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:30.264961 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:30.264961 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:30.264961 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:30.265847 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:30.265847 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:30.265847 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:30.265847 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:30.265847 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:30.265847 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:30.265847 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:30.265847 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:30.265847 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:30.265847 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:30.265847 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:38:30.265847 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:30.265847 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 02 20:38:30.265847 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:30.265847 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 396/787] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jul 2 20:38:30 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:30.271077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fdb0e-36f8-412d-b4a2-a643f884bd1d None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:30.290579 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:30.382928 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fdb0e-36f8-412d-b4a2-a643f884bd1d None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:30.420223 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de74aa-5963-416e-aa73-4077abea623a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:30.420989 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de74aa-5963-416e-aa73-4077abea623a None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:30.421273 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de74aa-5963-416e-aa73-4077abea623a None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:30.421549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de74aa-5963-416e-aa73-4077abea623a None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:30.422256 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de74aa-5963-416e-aa73-4077abea623a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:30.422563 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de74aa-5963-416e-aa73-4077abea623a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:30.424003 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de74aa-5963-416e-aa73-4077abea623a None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:30.429169 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 392/788] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jul 2 20:38:30 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:30.435162 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd91251-5e12-4186-ac15-3b8ca977aabe None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:30.455228 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:30.538487 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd91251-5e12-4186-ac15-3b8ca977aabe None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:30.572445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5453a42-2ab8-491a-b0c6-6fcad464ec94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:30.573103 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5453a42-2ab8-491a-b0c6-6fcad464ec94 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:30.573376 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5453a42-2ab8-491a-b0c6-6fcad464ec94 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:30.573639 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5453a42-2ab8-491a-b0c6-6fcad464ec94 None admin] PATH_INFO: `/v3/services` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:30.574339 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5453a42-2ab8-491a-b0c6-6fcad464ec94 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:30.574607 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5453a42-2ab8-491a-b0c6-6fcad464ec94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:30.576016 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5453a42-2ab8-491a-b0c6-6fcad464ec94 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:30.581449 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 397/789] 10.222.0.57 () {56 vars in 1114 bytes} [Sat Jul 2 20:38:30 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:30.587177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de74aa-5963-416e-aa73-4077abea623a None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:30.669514 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:30.689708 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de74aa-5963-416e-aa73-4077abea623a None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:30.725357 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add40de0-e4cd-4d5a-a30e-b693f442b0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:30.726019 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add40de0-e4cd-4d5a-a30e-b693f442b0e1 None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:30.726303 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add40de0-e4cd-4d5a-a30e-b693f442b0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:30.726575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add40de0-e4cd-4d5a-a30e-b693f442b0e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:30.727406 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add40de0-e4cd-4d5a-a30e-b693f442b0e1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:30.728782 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add40de0-e4cd-4d5a-a30e-b693f442b0e1 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:30.758938 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 393/790] 10.222.0.57 () {60 vars in 1144 bytes} [Sat Jul 2 20:38:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:38:31.517964 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35856b68-5fcd-4698-ac7a-8d9757865efe None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:31.518513 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35856b68-5fcd-4698-ac7a-8d9757865efe None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:31.518513 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35856b68-5fcd-4698-ac7a-8d9757865efe None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:31.519906 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 398/791] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:31.525366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288d574-5f7b-4bbd-b8a9-3fb393744099 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:31.525811 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288d574-5f7b-4bbd-b8a9-3fb393744099 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:31.525910 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2288d574-5f7b-4bbd-b8a9-3fb393744099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:31.543622 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-2288d574-5f7b-4bbd-b8a9-3fb393744099 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:31.544812 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-2288d574-5f7b-4bbd-b8a9-3fb393744099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:31.622959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 394/792] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:31 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:38:31.647082 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35856b68-5fcd-4698-ac7a-8d9757865efe None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:31.735246 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:31.755829 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35856b68-5fcd-4698-ac7a-8d9757865efe None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:31.788836 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9380f-fe36-4b29-95d9-54560e749922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:31.789542 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9380f-fe36-4b29-95d9-54560e749922 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:31.789817 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9380f-fe36-4b29-95d9-54560e749922 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:31.790077 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9380f-fe36-4b29-95d9-54560e749922 None admin] PATH_INFO: `/v3/services/compute` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:31.790706 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9380f-fe36-4b29-95d9-54560e749922 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:31.792101 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9380f-fe36-4b29-95d9-54560e749922 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:31.803875 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-78e9380f-fe36-4b29-95d9-54560e749922 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 20:38:31.803875 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:31.803875 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:38:31.803875 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:38:31.803875 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:38:31.803875 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:38:31.803875 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:38:31.803875 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:31.803875 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 20:38:31.803875 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:31.803875 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:38:31.803875 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:31.803875 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:31.803875 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:31.803875 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:31.803875 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:31.803875 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:31.804936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:31.804936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:31.804936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:31.804936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:31.804936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:31.804936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:31.804936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:38:31.804936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:38:31.804936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:38:31.804936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:38:31.804936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:31.804936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:31.804936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:31.804936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:31.804936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:31.804936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:31.805772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:31.805772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:31.805772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:31.805772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:31.805772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:31.805772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:31.805772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:31.805772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:31.805772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:31.805772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:31.805772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:38:31.805772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:31.805772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 20:38:31.805772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:31.805772 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 399/793] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:38:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:31.811096 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288d574-5f7b-4bbd-b8a9-3fb393744099 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:31.877575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:31.919601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2288d574-5f7b-4bbd-b8a9-3fb393744099 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:31.957018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc93da-f452-413f-86f6-e32e1cf0c29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:31.957681 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc93da-f452-413f-86f6-e32e1cf0c29e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:31.957965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc93da-f452-413f-86f6-e32e1cf0c29e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:31.958204 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc93da-f452-413f-86f6-e32e1cf0c29e None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:31.958940 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc93da-f452-413f-86f6-e32e1cf0c29e None admin] RBAC: Adding query filter params (name=compute) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:31.959258 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc93da-f452-413f-86f6-e32e1cf0c29e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:31.960645 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc93da-f452-413f-86f6-e32e1cf0c29e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:31.965753 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 395/794] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jul 2 20:38:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:31.972239 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9380f-fe36-4b29-95d9-54560e749922 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:32.078214 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9380f-fe36-4b29-95d9-54560e749922 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:32.113530 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255123b-da01-4bce-8950-b2dfddd76b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:32.114184 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255123b-da01-4bce-8950-b2dfddd76b2c None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:32.114469 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255123b-da01-4bce-8950-b2dfddd76b2c None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:32.114741 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255123b-da01-4bce-8950-b2dfddd76b2c None admin] PATH_INFO: `/v3/services` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:32.115478 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255123b-da01-4bce-8950-b2dfddd76b2c None admin] RBAC: Adding query filter params (type=compute) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:32.115781 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255123b-da01-4bce-8950-b2dfddd76b2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:32.117171 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255123b-da01-4bce-8950-b2dfddd76b2c None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:32.130940 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 400/795] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jul 2 20:38:31 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:33.069181 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ee899-c8ad-4e95-8c71-d7b0fb2175a7 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:33.069740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ee899-c8ad-4e95-8c71-d7b0fb2175a7 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:33.069740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ee899-c8ad-4e95-8c71-d7b0fb2175a7 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:33.071126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 396/796] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:33.076400 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a1d37-4abe-401f-ac03-17587bb50d7b None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:33.076857 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a1d37-4abe-401f-ac03-17587bb50d7b None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:33.076967 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a1d37-4abe-401f-ac03-17587bb50d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:33.094941 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-a77a1d37-4abe-401f-ac03-17587bb50d7b None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:33.096152 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-a77a1d37-4abe-401f-ac03-17587bb50d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:33.098204 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:33.167212 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 401/797] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:33 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:38:33.191806 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ee899-c8ad-4e95-8c71-d7b0fb2175a7 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:33.298869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ee899-c8ad-4e95-8c71-d7b0fb2175a7 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:33.328947 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:33.337936 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808742b1-4529-45e5-a50c-83e5dc39f8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:33.338603 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808742b1-4529-45e5-a50c-83e5dc39f8a7 None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:33.338884 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808742b1-4529-45e5-a50c-83e5dc39f8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:33.339193 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808742b1-4529-45e5-a50c-83e5dc39f8a7 None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:33.339957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808742b1-4529-45e5-a50c-83e5dc39f8a7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:33.341401 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808742b1-4529-45e5-a50c-83e5dc39f8a7 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:33.343138 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: WARNING keystone.server.flask.common [None req-808742b1-4529-45e5-a50c-83e5dc39f8a7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 02 20:38:33.361571 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.sql.core [None req-808742b1-4529-45e5-a50c-83e5dc39f8a7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 02 20:38:33.361571 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 02 20:38:33.361571 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [parameters: {'id': '10825f299a754eb6bd94dfa3d7525288', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 02 20:38:33.361571 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98933) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 02 20:38:33.378386 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-808742b1-4529-45e5-a50c-83e5dc39f8a7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 10825f299a754eb6bd94dfa3d7525288.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 10825f299a754eb6bd94dfa3d7525288. Jul 02 20:38:33.378386 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:33.378386 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 20:38:33.378386 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 02 20:38:33.378386 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 20:38:33.378386 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 02 20:38:33.378386 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 20:38:33.378386 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application result = self._query(query) Jul 02 20:38:33.378386 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 20:38:33.378386 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application conn.query(q) Jul 02 20:38:33.378386 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 20:38:33.378386 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 20:38:33.378386 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 20:38:33.379414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application result.read() Jul 02 20:38:33.379414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 20:38:33.379414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 02 20:38:33.379414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 20:38:33.379414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 02 20:38:33.379414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 20:38:33.379414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 02 20:38:33.379414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 20:38:33.379414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 02 20:38:33.379414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 02 20:38:33.379414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:33.379414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 02 20:38:33.379414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:33.379414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:33.379414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 02 20:38:33.379414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 02 20:38:33.379414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 02 20:38:33.379414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 02 20:38:33.380451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 02 20:38:33.380451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application next(self.gen) Jul 02 20:38:33.380451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 02 20:38:33.380451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application yield resource Jul 02 20:38:33.380451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 02 20:38:33.380451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application next(self.gen) Jul 02 20:38:33.380451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 02 20:38:33.380451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self.session.rollback() Jul 02 20:38:33.380451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 20:38:33.380451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self.force_reraise() Jul 02 20:38:33.380451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 20:38:33.380451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise self.value Jul 02 20:38:33.380451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 02 20:38:33.380451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 02 20:38:33.380451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 02 20:38:33.380451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application session.commit() Jul 02 20:38:33.380451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 02 20:38:33.381402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 02 20:38:33.381402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 02 20:38:33.381402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._prepare_impl() Jul 02 20:38:33.381402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 02 20:38:33.381402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self.session.flush() Jul 02 20:38:33.381402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 02 20:38:33.381402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._flush(objects) Jul 02 20:38:33.381402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 02 20:38:33.381402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 02 20:38:33.381402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 02 20:38:33.381402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application compat.raise_( Jul 02 20:38:33.381402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 20:38:33.381402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception Jul 02 20:38:33.381402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 02 20:38:33.381402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application flush_context.execute() Jul 02 20:38:33.381402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 02 20:38:33.381402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rec.execute(self) Jul 02 20:38:33.382348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 02 20:38:33.382348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 02 20:38:33.382348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 02 20:38:33.382348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 02 20:38:33.382348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 02 20:38:33.382348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 02 20:38:33.382348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 02 20:38:33.382348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 02 20:38:33.382348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 02 20:38:33.382348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 02 20:38:33.382348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 02 20:38:33.382348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 02 20:38:33.382348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 02 20:38:33.382348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 02 20:38:33.382348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 02 20:38:33.385232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 02 20:38:33.385232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 20:38:33.385232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception Jul 02 20:38:33.385232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 20:38:33.385232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 02 20:38:33.385232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 20:38:33.385232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 02 20:38:33.385232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 20:38:33.385232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application result = self._query(query) Jul 02 20:38:33.385232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 20:38:33.385232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application conn.query(q) Jul 02 20:38:33.385232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 20:38:33.385232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 20:38:33.385232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 20:38:33.385232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application result.read() Jul 02 20:38:33.385232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 20:38:33.385232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 02 20:38:33.386802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 20:38:33.386802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 02 20:38:33.386802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 20:38:33.386802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 02 20:38:33.386802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 20:38:33.386802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 02 20:38:33.386802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 02 20:38:33.386802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 02 20:38:33.386802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [parameters: {'id': '10825f299a754eb6bd94dfa3d7525288', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 02 20:38:33.386802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 02 20:38:33.386802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:33.386802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:38:33.386802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:33.386802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:33.386802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 02 20:38:33.387829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 02 20:38:33.387829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 02 20:38:33.387829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 02 20:38:33.387829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 02 20:38:33.387829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:33.387829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:38:33.387829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:33.387829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:33.387829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:33.387829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:33.387829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:33.387829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:33.387829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:33.387829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:33.387829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:33.387829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:33.387829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:33.389293 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:33.389293 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 02 20:38:33.389293 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 02 20:38:33.389293 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:33.389293 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:33.389293 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 02 20:38:33.389293 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 02 20:38:33.389293 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 10825f299a754eb6bd94dfa3d7525288. Jul 02 20:38:33.389293 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:33.389293 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 397/798] 10.222.0.57 () {60 vars in 1140 bytes} [Sat Jul 2 20:38:33 2022] POST /identity/v3/projects => generated 262 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:33.390049 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a1d37-4abe-401f-ac03-17587bb50d7b None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:33.486957 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a1d37-4abe-401f-ac03-17587bb50d7b None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:33.521080 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286f417-d3e2-4ffc-be21-8700b0618565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:33.521871 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286f417-d3e2-4ffc-be21-8700b0618565 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:33.522167 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286f417-d3e2-4ffc-be21-8700b0618565 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:33.522430 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286f417-d3e2-4ffc-be21-8700b0618565 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:33.529140 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286f417-d3e2-4ffc-be21-8700b0618565 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:33.530812 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286f417-d3e2-4ffc-be21-8700b0618565 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:33.532726 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:33.545364 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-d286f417-d3e2-4ffc-be21-8700b0618565 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:38:33.545364 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:33.545364 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:33.545364 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:33.545364 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:33.545364 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:33.545364 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:33.545364 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:33.545364 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:33.545364 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:33.545364 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:33.545364 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:33.545364 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:38:33.545364 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:38:33.545364 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:38:33.546410 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:38:33.546410 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:33.546410 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:33.546410 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:33.546410 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:33.546410 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:33.546410 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:33.546410 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:33.546410 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:33.546410 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:33.546410 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:33.546410 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:33.546410 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:33.546410 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:33.546410 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:33.546410 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:33.546410 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:33.547652 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:38:33.547652 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:38:33.547652 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:38:33.547652 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:38:33.547652 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:38:33.547652 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:38:33.547652 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:38:33.547652 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:33.547652 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 402/799] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:38:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:33.552776 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808742b1-4529-45e5-a50c-83e5dc39f8a7 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:33.655659 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808742b1-4529-45e5-a50c-83e5dc39f8a7 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:33.689882 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a07ba8-d616-4a96-bc89-fc7e7a7bd869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:33.690543 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a07ba8-d616-4a96-bc89-fc7e7a7bd869 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:33.690820 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a07ba8-d616-4a96-bc89-fc7e7a7bd869 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:33.691106 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a07ba8-d616-4a96-bc89-fc7e7a7bd869 None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:33.691885 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a07ba8-d616-4a96-bc89-fc7e7a7bd869 None admin] RBAC: Adding query filter params (name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:33.692193 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a07ba8-d616-4a96-bc89-fc7e7a7bd869 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:33.693818 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a07ba8-d616-4a96-bc89-fc7e7a7bd869 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:33.716576 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 398/800] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jul 2 20:38:33 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:38:34.415345 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e2702-2871-4966-b55e-1bcd9a943723 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:34.415879 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e2702-2871-4966-b55e-1bcd9a943723 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:34.415879 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e2702-2871-4966-b55e-1bcd9a943723 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:34.417419 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 403/801] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:34.423242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bef71a-af3f-459e-9565-013eb6e0beb3 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:34.423688 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bef71a-af3f-459e-9565-013eb6e0beb3 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:34.423777 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bef71a-af3f-459e-9565-013eb6e0beb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:34.441587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-16bef71a-af3f-459e-9565-013eb6e0beb3 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:34.443135 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-16bef71a-af3f-459e-9565-013eb6e0beb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:34.486853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:34.516079 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 399/802] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:34 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:38:34.540405 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e2702-2871-4966-b55e-1bcd9a943723 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:34.644217 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e2702-2871-4966-b55e-1bcd9a943723 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:34.678503 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a5f7cb-6e8a-43fc-be32-08a0ccbf8bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:34.679133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5f7cb-6e8a-43fc-be32-08a0ccbf8bf2 None admin] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:34.679412 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5f7cb-6e8a-43fc-be32-08a0ccbf8bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:34.679682 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a5f7cb-6e8a-43fc-be32-08a0ccbf8bf2 None admin] PATH_INFO: `/v3/services` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:34.680401 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5f7cb-6e8a-43fc-be32-08a0ccbf8bf2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:34.681848 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a5f7cb-6e8a-43fc-be32-08a0ccbf8bf2 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:34.696869 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 404/803] 10.222.0.57 () {60 vars in 1141 bytes} [Sat Jul 2 20:38:34 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:38:36.011228 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ec2c1-2927-4d24-b9d9-33910f305127 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:36.011723 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ec2c1-2927-4d24-b9d9-33910f305127 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:36.011723 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59ec2c1-2927-4d24-b9d9-33910f305127 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:36.013090 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 400/804] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:36.018360 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32569a8c-eb86-430e-9b0a-f19157d42e67 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:36.018761 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32569a8c-eb86-430e-9b0a-f19157d42e67 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:36.019019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32569a8c-eb86-430e-9b0a-f19157d42e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:36.036392 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-32569a8c-eb86-430e-9b0a-f19157d42e67 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:36.037565 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-32569a8c-eb86-430e-9b0a-f19157d42e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:36.093801 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:36.115206 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 405/805] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:36 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:38:36.141068 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ec2c1-2927-4d24-b9d9-33910f305127 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:36.245416 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59ec2c1-2927-4d24-b9d9-33910f305127 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:36.282460 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a9b7a-d276-46ec-b53f-2c25ca1f6fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:36.283094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a9b7a-d276-46ec-b53f-2c25ca1f6fbb None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:36.283379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a9b7a-d276-46ec-b53f-2c25ca1f6fbb None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:36.283653 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a9b7a-d276-46ec-b53f-2c25ca1f6fbb None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:36.284356 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a9b7a-d276-46ec-b53f-2c25ca1f6fbb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:36.285802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27a9b7a-d276-46ec-b53f-2c25ca1f6fbb None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:36.299907 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.sql.core [None req-f27a9b7a-d276-46ec-b53f-2c25ca1f6fbb None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 02 20:38:36.299907 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 02 20:38:36.299907 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [parameters: {'user_id': '631496882e5e458cbde2298bef4d7b6e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 02 20:38:36.299907 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=98933) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 02 20:38:36.307249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-f27a9b7a-d276-46ec-b53f-2c25ca1f6fbb None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 02 20:38:36.307249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:36.307249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 20:38:36.307249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 02 20:38:36.307249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 20:38:36.307249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 02 20:38:36.307249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 20:38:36.307249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application result = self._query(query) Jul 02 20:38:36.307249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 20:38:36.307249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application conn.query(q) Jul 02 20:38:36.307249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 20:38:36.307249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 20:38:36.307249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 20:38:36.307249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application result.read() Jul 02 20:38:36.307249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 20:38:36.308197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 02 20:38:36.308197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 20:38:36.308197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 02 20:38:36.308197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 20:38:36.308197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 02 20:38:36.308197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 20:38:36.308197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 02 20:38:36.308197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 02 20:38:36.308197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:36.308197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 02 20:38:36.308197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:36.308197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:36.308197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 02 20:38:36.308197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 02 20:38:36.308197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 02 20:38:36.308197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 02 20:38:36.308197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 02 20:38:36.308197 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application next(self.gen) Jul 02 20:38:36.309124 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 02 20:38:36.309124 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application yield resource Jul 02 20:38:36.309124 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 02 20:38:36.309124 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application next(self.gen) Jul 02 20:38:36.309124 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 02 20:38:36.309124 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self.session.rollback() Jul 02 20:38:36.309124 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 02 20:38:36.309124 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self.force_reraise() Jul 02 20:38:36.309124 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 02 20:38:36.309124 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise self.value Jul 02 20:38:36.309124 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 02 20:38:36.309124 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 02 20:38:36.309124 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 02 20:38:36.309124 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application session.commit() Jul 02 20:38:36.309124 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 02 20:38:36.309124 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 02 20:38:36.309124 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 02 20:38:36.309987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._prepare_impl() Jul 02 20:38:36.309987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 02 20:38:36.309987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self.session.flush() Jul 02 20:38:36.309987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 02 20:38:36.309987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._flush(objects) Jul 02 20:38:36.309987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 02 20:38:36.309987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 02 20:38:36.309987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 02 20:38:36.309987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application compat.raise_( Jul 02 20:38:36.309987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 20:38:36.309987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception Jul 02 20:38:36.309987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 02 20:38:36.309987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application flush_context.execute() Jul 02 20:38:36.309987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 02 20:38:36.309987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rec.execute(self) Jul 02 20:38:36.309987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 02 20:38:36.309987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 02 20:38:36.310860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 02 20:38:36.310860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 02 20:38:36.310860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 02 20:38:36.310860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 02 20:38:36.310860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 02 20:38:36.310860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 02 20:38:36.310860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 02 20:38:36.310860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 02 20:38:36.310860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 02 20:38:36.310860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 02 20:38:36.310860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 02 20:38:36.310860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 02 20:38:36.310860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 02 20:38:36.310860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 02 20:38:36.310860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 02 20:38:36.310860 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception Jul 02 20:38:36.311823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 02 20:38:36.311823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 02 20:38:36.311823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 02 20:38:36.311823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 02 20:38:36.311823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 02 20:38:36.311823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application result = self._query(query) Jul 02 20:38:36.311823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 02 20:38:36.311823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application conn.query(q) Jul 02 20:38:36.311823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 02 20:38:36.311823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 02 20:38:36.311823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 02 20:38:36.311823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application result.read() Jul 02 20:38:36.311823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 02 20:38:36.311823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 02 20:38:36.311823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 02 20:38:36.311823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 02 20:38:36.312624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 02 20:38:36.312624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 02 20:38:36.312624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 02 20:38:36.312624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 02 20:38:36.312624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 02 20:38:36.312624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 02 20:38:36.312624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [parameters: {'user_id': '631496882e5e458cbde2298bef4d7b6e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 02 20:38:36.312624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 02 20:38:36.312624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:36.312624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:38:36.312624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:36.312624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:36.312624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:36.312624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:36.312624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:36.313396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:36.313396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:36.313396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:36.313396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:36.313396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:36.313396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:36.313396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:36.313396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 02 20:38:36.313396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 02 20:38:36.313396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:36.313396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:36.313396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:38:36.313396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:38:36.313396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:38:36.313396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:38:36.313396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 02 20:38:36.313396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 02 20:38:36.314310 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 02 20:38:36.314310 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 02 20:38:36.314310 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 02 20:38:36.314310 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 02 20:38:36.314310 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 02 20:38:36.314310 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:36.314310 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 401/806] 10.222.0.57 () {60 vars in 1131 bytes} [Sat Jul 2 20:38:36 2022] POST /identity/v3/users => generated 160 bytes in 168 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:36.314693 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32569a8c-eb86-430e-9b0a-f19157d42e67 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:36.416315 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32569a8c-eb86-430e-9b0a-f19157d42e67 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:36.450293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d487c2-eadc-4d3f-9eca-64f1ec743667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:36.451147 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d487c2-eadc-4d3f-9eca-64f1ec743667 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:36.451426 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d487c2-eadc-4d3f-9eca-64f1ec743667 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:36.451700 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d487c2-eadc-4d3f-9eca-64f1ec743667 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:36.459908 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d487c2-eadc-4d3f-9eca-64f1ec743667 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:36.461380 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d487c2-eadc-4d3f-9eca-64f1ec743667 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:36.476065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-33d487c2-eadc-4d3f-9eca-64f1ec743667 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 02 20:38:36.476065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:36.476065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:36.476065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:36.476065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:36.476065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:36.476065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:36.476065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:36.476065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:36.476065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:36.476065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:36.476065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:36.476065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:38:36.476065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:38:36.476065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:38:36.476065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:38:36.477149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:36.477149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:36.477149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:38:36.477149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:38:36.477149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:38:36.477149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:38:36.477149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:36.477149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:36.477149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:36.477149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:36.477149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:36.477149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:36.477149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:36.477149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:36.477149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:36.477149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:36.477149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:36.477149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:36.478267 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:36.478267 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:36.478267 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:38:36.478267 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:38:36.478267 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:38:36.478267 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:38:36.478267 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:38:36.478267 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:38:36.478267 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 02 20:38:36.478267 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:36.482199 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 406/807] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:38:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:36.483575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a9b7a-d276-46ec-b53f-2c25ca1f6fbb None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:36.520994 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:36.585993 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a9b7a-d276-46ec-b53f-2c25ca1f6fbb None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:36.621255 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0dbf71-bf4f-4774-a045-56c5bbf077e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:36.621928 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dbf71-bf4f-4774-a045-56c5bbf077e2 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:36.622208 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dbf71-bf4f-4774-a045-56c5bbf077e2 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:36.622476 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0dbf71-bf4f-4774-a045-56c5bbf077e2 None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:36.623317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0dbf71-bf4f-4774-a045-56c5bbf077e2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:36.623622 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0dbf71-bf4f-4774-a045-56c5bbf077e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:36.625321 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0dbf71-bf4f-4774-a045-56c5bbf077e2 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:36.663079 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 402/808] 10.222.0.57 () {56 vars in 1101 bytes} [Sat Jul 2 20:38:36 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:37.005904 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aba562-c663-4ecc-97da-94ea03a9ad25 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:37.006228 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aba562-c663-4ecc-97da-94ea03a9ad25 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:37.006745 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aba562-c663-4ecc-97da-94ea03a9ad25 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:37.009051 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 407/809] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:37.015919 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a06fa2-4bd0-4721-8e80-ca97526aa73a None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:37.016651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a06fa2-4bd0-4721-8e80-ca97526aa73a None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:37.016790 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a06fa2-4bd0-4721-8e80-ca97526aa73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:37.040202 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-f0a06fa2-4bd0-4721-8e80-ca97526aa73a None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:37.041737 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-f0a06fa2-4bd0-4721-8e80-ca97526aa73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:37.116374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 403/810] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:37 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:38:37.141060 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aba562-c663-4ecc-97da-94ea03a9ad25 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:37.196189 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:37.252192 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aba562-c663-4ecc-97da-94ea03a9ad25 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:37.289748 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0deba95-b7cc-42d2-a255-8f77b293ea02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:37.290465 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0deba95-b7cc-42d2-a255-8f77b293ea02 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:37.290739 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0deba95-b7cc-42d2-a255-8f77b293ea02 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:37.291040 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0deba95-b7cc-42d2-a255-8f77b293ea02 None admin] PATH_INFO: `/v3/services/compute` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:37.291673 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0deba95-b7cc-42d2-a255-8f77b293ea02 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:37.293037 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0deba95-b7cc-42d2-a255-8f77b293ea02 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:37.305155 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-e0deba95-b7cc-42d2-a255-8f77b293ea02 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 20:38:37.305155 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:37.305155 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:38:37.305155 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:38:37.305155 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:38:37.305155 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:38:37.305155 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:38:37.305155 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:37.305155 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 20:38:37.305155 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:37.305155 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:38:37.305155 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:37.305155 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:37.305155 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:37.305155 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:37.305155 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:37.305155 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:37.306292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:37.306292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:37.306292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:37.306292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:37.306292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:37.306292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:37.306292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:38:37.306292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:38:37.306292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:38:37.306292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:38:37.306292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:37.306292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:37.306292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:37.306292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:37.306292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:37.306292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:37.307171 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:37.307171 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:37.307171 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:37.307171 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:37.307171 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:37.307171 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:37.307171 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:37.307171 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:37.307171 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:37.307171 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:37.307171 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:38:37.307171 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:37.307171 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 20:38:37.307171 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:38:37.307171 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 408/811] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:38:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:37.313763 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a06fa2-4bd0-4721-8e80-ca97526aa73a None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:37.340777 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:37.433194 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a06fa2-4bd0-4721-8e80-ca97526aa73a None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:37.472518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f9fbf-3d00-4222-835f-f8e8fea457c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:37.473176 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f9fbf-3d00-4222-835f-f8e8fea457c8 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:37.473454 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f9fbf-3d00-4222-835f-f8e8fea457c8 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:37.473723 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f9fbf-3d00-4222-835f-f8e8fea457c8 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:37.474428 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f9fbf-3d00-4222-835f-f8e8fea457c8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:37.474729 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f9fbf-3d00-4222-835f-f8e8fea457c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:37.476150 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1f9fbf-3d00-4222-835f-f8e8fea457c8 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:37.481231 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 404/812] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jul 2 20:38:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:38:37.487907 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0deba95-b7cc-42d2-a255-8f77b293ea02 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:37.592010 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0deba95-b7cc-42d2-a255-8f77b293ea02 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:37.600646 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:37.627144 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0db138-89bd-4108-86fd-005bcf0afa25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:37.627797 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0db138-89bd-4108-86fd-005bcf0afa25 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:37.628069 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0db138-89bd-4108-86fd-005bcf0afa25 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:37.628336 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0db138-89bd-4108-86fd-005bcf0afa25 None admin] PATH_INFO: `/v3/services` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:37.629028 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0db138-89bd-4108-86fd-005bcf0afa25 None admin] RBAC: Adding query filter params (type=compute) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:37.629327 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0db138-89bd-4108-86fd-005bcf0afa25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:37.630690 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0db138-89bd-4108-86fd-005bcf0afa25 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:37.635531 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 409/813] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jul 2 20:38:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:37.642672 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f9fbf-3d00-4222-835f-f8e8fea457c8 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:37.748262 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:37.760915 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f9fbf-3d00-4222-835f-f8e8fea457c8 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:37.795308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f7910-3f94-4a58-81bc-3273629a0899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:37.796001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f7910-3f94-4a58-81bc-3273629a0899 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:37.796273 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f7910-3f94-4a58-81bc-3273629a0899 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:37.796539 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f7910-3f94-4a58-81bc-3273629a0899 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:37.797307 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f7910-3f94-4a58-81bc-3273629a0899 None admin] RBAC: Adding query filter params (interface=public, service_id=f3a759f360364d17bff5806fbef4fbee, region_id=RegionOne) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:37.797605 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f7910-3f94-4a58-81bc-3273629a0899 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:37.799059 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66f7910-3f94-4a58-81bc-3273629a0899 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:37.803996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 405/814] 10.222.0.57 () {56 vars in 1251 bytes} [Sat Jul 2 20:38:37 2022] GET /identity/v3/endpoints?service_id=f3a759f360364d17bff5806fbef4fbee&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:37.813322 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0db138-89bd-4108-86fd-005bcf0afa25 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:37.941165 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0db138-89bd-4108-86fd-005bcf0afa25 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:37.981168 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c284faf-7120-4ae8-abd9-2ae013e328bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:37.981819 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c284faf-7120-4ae8-abd9-2ae013e328bc None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:37.982094 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c284faf-7120-4ae8-abd9-2ae013e328bc None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:37.982364 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c284faf-7120-4ae8-abd9-2ae013e328bc None admin] PATH_INFO: `/v3/services` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:37.983042 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c284faf-7120-4ae8-abd9-2ae013e328bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:37.984627 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c284faf-7120-4ae8-abd9-2ae013e328bc None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:37.990878 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 410/815] 10.222.0.57 () {56 vars in 1087 bytes} [Sat Jul 2 20:38:37 2022] GET /identity/v3/services => generated 1728 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 20:38:40.231833 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dccfb-9248-47df-8be7-5307603f2e77 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:40.232665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dccfb-9248-47df-8be7-5307603f2e77 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:40.232665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38dccfb-9248-47df-8be7-5307603f2e77 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:40.234504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 406/816] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:38:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:38:40.240148 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf82e2d-1a5b-4ba9-a641-754ff2d100bf None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:40.240560 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf82e2d-1a5b-4ba9-a641-754ff2d100bf None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:40.240669 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf82e2d-1a5b-4ba9-a641-754ff2d100bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:40.258808 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-bbf82e2d-1a5b-4ba9-a641-754ff2d100bf None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:38:40.260030 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-bbf82e2d-1a5b-4ba9-a641-754ff2d100bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:38:40.291375 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:40.332671 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 411/817] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:38:40 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:38:40.368213 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38dccfb-9248-47df-8be7-5307603f2e77 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:40.473380 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38dccfb-9248-47df-8be7-5307603f2e77 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:40.512090 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87f391-34f6-4aff-83d9-431358ae0429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:40.512815 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87f391-34f6-4aff-83d9-431358ae0429 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:40.513097 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87f391-34f6-4aff-83d9-431358ae0429 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:40.513361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e87f391-34f6-4aff-83d9-431358ae0429 None admin] PATH_INFO: `/v3/services/compute` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:40.514001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87f391-34f6-4aff-83d9-431358ae0429 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:40.515559 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e87f391-34f6-4aff-83d9-431358ae0429 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:40.527433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-8e87f391-34f6-4aff-83d9-431358ae0429 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 20:38:40.527433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:40.527433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:38:40.527433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:38:40.527433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:38:40.527433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:38:40.527433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:38:40.527433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:40.527433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 20:38:40.527433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:40.527433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:38:40.527433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:40.527433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:38:40.527433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:38:40.527433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:38:40.527433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:38:40.527433 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:38:40.528549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:38:40.528549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:38:40.528549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:38:40.528549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:38:40.528549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:38:40.528549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:38:40.528549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:38:40.528549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:38:40.528549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:38:40.528549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:38:40.528549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:38:40.528549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:38:40.528549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:38:40.528549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:38:40.528549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:38:40.528549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:38:40.529404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:38:40.529404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:38:40.529404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:38:40.529404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:38:40.529404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:38:40.529404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:38:40.529404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:38:40.529404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:38:40.529404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:38:40.529404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:38:40.529404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:38:40.529404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:38:40.529404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 02 20:38:40.529404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:38:40.529404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 407/818] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:38:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:38:40.535201 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf82e2d-1a5b-4ba9-a641-754ff2d100bf None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:40.652438 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf82e2d-1a5b-4ba9-a641-754ff2d100bf None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:40.690157 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820338d5-f78d-4018-a449-439a9b3c2ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:40.690807 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820338d5-f78d-4018-a449-439a9b3c2ed7 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:40.691113 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820338d5-f78d-4018-a449-439a9b3c2ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:40.691382 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820338d5-f78d-4018-a449-439a9b3c2ed7 None admin] PATH_INFO: `/v3/services` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:40.692078 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820338d5-f78d-4018-a449-439a9b3c2ed7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:40.692380 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820338d5-f78d-4018-a449-439a9b3c2ed7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:40.693753 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820338d5-f78d-4018-a449-439a9b3c2ed7 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:40.698933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 412/819] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jul 2 20:38:40 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:40.706283 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87f391-34f6-4aff-83d9-431358ae0429 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:40.731832 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:40.817751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e87f391-34f6-4aff-83d9-431358ae0429 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:40.856313 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94402c26-e1f1-4a73-ba6b-f67d6113e462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:40.856966 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94402c26-e1f1-4a73-ba6b-f67d6113e462 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:40.857245 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94402c26-e1f1-4a73-ba6b-f67d6113e462 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:40.857523 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94402c26-e1f1-4a73-ba6b-f67d6113e462 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:40.858446 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94402c26-e1f1-4a73-ba6b-f67d6113e462 None admin] RBAC: Adding query filter params (type=compute) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:38:40.859122 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94402c26-e1f1-4a73-ba6b-f67d6113e462 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:40.860508 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94402c26-e1f1-4a73-ba6b-f67d6113e462 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:40.865624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 408/820] 10.222.0.57 () {56 vars in 1112 bytes} [Sat Jul 2 20:38:40 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:38:40.874626 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820338d5-f78d-4018-a449-439a9b3c2ed7 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:38:40.906682 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:40.979556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820338d5-f78d-4018-a449-439a9b3c2ed7 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:38:41.015743 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e94eb2-c65d-402b-962a-9d543669389a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:38:41.016394 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e94eb2-c65d-402b-962a-9d543669389a None admin] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:38:41.016675 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e94eb2-c65d-402b-962a-9d543669389a None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:38:41.016948 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e94eb2-c65d-402b-962a-9d543669389a None admin] PATH_INFO: `/v3/endpoints` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:38:41.017695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e94eb2-c65d-402b-962a-9d543669389a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:38:41.019111 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e94eb2-c65d-402b-962a-9d543669389a None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:38:41.048439 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 413/821] 10.222.0.57 () {60 vars in 1144 bytes} [Sat Jul 2 20:38:40 2022] POST /identity/v3/endpoints => generated 334 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 20:38:50.863037 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=60 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:38:51.041786 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=56,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:43.100466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb8ef9-c6d4-492b-a8d6-130fedbf49df None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:43.101156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb8ef9-c6d4-492b-a8d6-130fedbf49df None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:43.101156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb8ef9-c6d4-492b-a8d6-130fedbf49df None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:43.102554 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 409/822] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:39:43.108348 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43783d2-35d5-4214-a882-0a2080ae9886 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:43.108938 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43783d2-35d5-4214-a882-0a2080ae9886 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:43.109034 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43783d2-35d5-4214-a882-0a2080ae9886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:43.128988 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-c43783d2-35d5-4214-a882-0a2080ae9886 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:39:43.130421 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-c43783d2-35d5-4214-a882-0a2080ae9886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:39:43.218556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 414/823] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:39:43 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:39:43.246547 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb8ef9-c6d4-492b-a8d6-130fedbf49df None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:43.366266 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb8ef9-c6d4-492b-a8d6-130fedbf49df None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:43.407505 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f23db-bc69-47cc-b974-f9dc7784925c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:43.408318 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f23db-bc69-47cc-b974-f9dc7784925c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:43.408681 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f23db-bc69-47cc-b974-f9dc7784925c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:43.408877 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f23db-bc69-47cc-b974-f9dc7784925c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:43.421038 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f23db-bc69-47cc-b974-f9dc7784925c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:43.423493 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f23db-bc69-47cc-b974-f9dc7784925c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:43.444018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-3a8f23db-bc69-47cc-b974-f9dc7784925c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:39:43.444018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:39:43.444018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:39:43.444018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:39:43.444018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:39:43.444018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:39:43.444018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:39:43.444018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:39:43.444018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:39:43.444018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:39:43.444018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:39:43.444018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:39:43.444018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:39:43.444018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:39:43.444018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:39:43.445568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:39:43.445568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:39:43.445568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:39:43.445568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:39:43.445568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:39:43.445568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:39:43.445568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:39:43.445568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:39:43.445568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:39:43.445568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:39:43.445568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:39:43.445568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:39:43.445568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:39:43.445568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:39:43.445568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:39:43.445568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:39:43.445568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:39:43.446604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:39:43.446604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:39:43.446604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:39:43.446604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:39:43.446604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 410/824] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:39:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:39:43.451788 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43783d2-35d5-4214-a882-0a2080ae9886 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:43.572549 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43783d2-35d5-4214-a882-0a2080ae9886 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:43.600907 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:43.612322 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d335bd-bb2b-474b-b71f-8d1973577413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:43.613119 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d335bd-bb2b-474b-b71f-8d1973577413 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:43.613418 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d335bd-bb2b-474b-b71f-8d1973577413 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:43.613756 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d335bd-bb2b-474b-b71f-8d1973577413 None admin] PATH_INFO: `/v3/domains` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:43.614647 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d335bd-bb2b-474b-b71f-8d1973577413 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:39:43.615138 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d335bd-bb2b-474b-b71f-8d1973577413 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:43.616961 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d335bd-bb2b-474b-b71f-8d1973577413 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:43.634431 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 415/825] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:39:43.641549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f23db-bc69-47cc-b974-f9dc7784925c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:43.708651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:43.764107 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f23db-bc69-47cc-b974-f9dc7784925c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:43.802771 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6bfb12-9e71-48bb-b8c6-2e19af1f100d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:43.803515 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bfb12-9e71-48bb-b8c6-2e19af1f100d None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:43.803857 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bfb12-9e71-48bb-b8c6-2e19af1f100d None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:43.804069 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bfb12-9e71-48bb-b8c6-2e19af1f100d None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:43.804789 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bfb12-9e71-48bb-b8c6-2e19af1f100d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:43.806244 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6bfb12-9e71-48bb-b8c6-2e19af1f100d None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:43.826881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 411/826] 10.222.0.57 () {60 vars in 1132 bytes} [Sat Jul 2 20:39:43 2022] POST /identity/v3/users => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:39:46.421813 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15acf6-0aa8-4770-8c8c-2437c5701f26 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:46.423915 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15acf6-0aa8-4770-8c8c-2437c5701f26 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:46.423915 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15acf6-0aa8-4770-8c8c-2437c5701f26 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:46.424136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 416/827] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:39:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:39:46.430898 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a80ef5-2af3-4205-81c7-2c8b45ac79a0 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:46.431501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a80ef5-2af3-4205-81c7-2c8b45ac79a0 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:46.431501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a80ef5-2af3-4205-81c7-2c8b45ac79a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:46.451412 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-e1a80ef5-2af3-4205-81c7-2c8b45ac79a0 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:39:46.453115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-e1a80ef5-2af3-4205-81c7-2c8b45ac79a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:39:46.526569 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 412/828] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:39:46 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:39:46.554021 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15acf6-0aa8-4770-8c8c-2437c5701f26 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:46.661468 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15acf6-0aa8-4770-8c8c-2437c5701f26 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:46.698073 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0f190-2cf6-406c-903f-8dd0b230148f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:46.698073 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0f190-2cf6-406c-903f-8dd0b230148f None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:46.698073 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0f190-2cf6-406c-903f-8dd0b230148f None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:46.698073 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0f190-2cf6-406c-903f-8dd0b230148f None admin] PATH_INFO: `/v3/roles/service` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:46.709790 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0f190-2cf6-406c-903f-8dd0b230148f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:39:46.718776 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-0da0f190-2cf6-406c-903f-8dd0b230148f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:39:46.718776 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:39:46.718776 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:39:46.718776 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:39:46.718776 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:39:46.718776 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:39:46.718776 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:39:46.718776 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:39:46.718776 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:39:46.718776 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:39:46.718776 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:39:46.718776 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:39:46.718776 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:39:46.718776 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:39:46.718776 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:39:46.718776 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:39:46.719912 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:39:46.719912 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:39:46.719912 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:39:46.719912 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:39:46.719912 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:39:46.719912 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:39:46.719912 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:39:46.719912 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:39:46.719912 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:39:46.719912 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:39:46.719912 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:39:46.719912 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:39:46.719912 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:39:46.719912 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:39:46.719912 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:39:46.719912 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:39:46.720811 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:39:46.720811 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:39:46.720811 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:39:46.720811 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:39:46.720811 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:39:46.720811 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:39:46.720811 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:39:46.720811 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:39:46.720811 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:39:46.720811 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:39:46.720811 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:39:46.720811 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:39:46.720811 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 417/829] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jul 2 20:39:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:39:46.727664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a80ef5-2af3-4205-81c7-2c8b45ac79a0 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:46.768088 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:46.836822 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a80ef5-2af3-4205-81c7-2c8b45ac79a0 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:46.873586 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9f943-c28d-42ee-83de-399a03349828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:46.874296 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9f943-c28d-42ee-83de-399a03349828 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:46.874979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9f943-c28d-42ee-83de-399a03349828 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:46.874979 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f9f943-c28d-42ee-83de-399a03349828 None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:46.875605 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9f943-c28d-42ee-83de-399a03349828 None admin] RBAC: Adding query filter params (name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:39:46.875973 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9f943-c28d-42ee-83de-399a03349828 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:46.877561 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f9f943-c28d-42ee-83de-399a03349828 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:46.886153 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 413/830] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jul 2 20:39:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:39:46.892277 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0f190-2cf6-406c-903f-8dd0b230148f None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:46.947090 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:47.010646 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0f190-2cf6-406c-903f-8dd0b230148f None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:47.048246 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898af422-81ba-402e-aab3-7277db9b328f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:47.049199 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898af422-81ba-402e-aab3-7277db9b328f None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:47.049580 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898af422-81ba-402e-aab3-7277db9b328f None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:47.049992 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898af422-81ba-402e-aab3-7277db9b328f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:47.062790 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898af422-81ba-402e-aab3-7277db9b328f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:47.064292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898af422-81ba-402e-aab3-7277db9b328f None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:47.083859 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-898af422-81ba-402e-aab3-7277db9b328f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:39:47.083859 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:39:47.083859 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:39:47.083859 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:39:47.083859 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:39:47.083859 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:39:47.083859 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:39:47.083859 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:39:47.083859 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:39:47.083859 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:39:47.083859 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:39:47.083859 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:39:47.083859 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:39:47.083859 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:39:47.083859 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:39:47.085077 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:39:47.085077 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:39:47.085077 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:39:47.085077 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:39:47.085077 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:39:47.085077 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:39:47.085077 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:39:47.085077 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:39:47.085077 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:39:47.085077 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:39:47.085077 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:39:47.085077 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:39:47.085077 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:39:47.085077 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:39:47.085077 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:39:47.085077 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:39:47.085077 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:39:47.086048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:39:47.086048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:39:47.086048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:39:47.086048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:39:47.086048 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 418/831] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:39:47.091406 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9f943-c28d-42ee-83de-399a03349828 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:47.198268 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:47.202071 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f9f943-c28d-42ee-83de-399a03349828 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:47.246894 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfedad-4549-4a1b-a28d-73389791831f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:47.247694 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfedad-4549-4a1b-a28d-73389791831f None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:47.247983 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfedad-4549-4a1b-a28d-73389791831f None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:47.248260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cfedad-4549-4a1b-a28d-73389791831f None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:47.249267 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfedad-4549-4a1b-a28d-73389791831f None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:39:47.250056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfedad-4549-4a1b-a28d-73389791831f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:47.251164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cfedad-4549-4a1b-a28d-73389791831f None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:47.265436 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 414/832] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:39:47.271217 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898af422-81ba-402e-aab3-7277db9b328f None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:47.381515 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:47.386119 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898af422-81ba-402e-aab3-7277db9b328f None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:47.432605 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082ca6d-3d6e-45d0-930d-be4ef7970e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:47.433557 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082ca6d-3d6e-45d0-930d-be4ef7970e23 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:47.433832 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082ca6d-3d6e-45d0-930d-be4ef7970e23 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:47.434156 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082ca6d-3d6e-45d0-930d-be4ef7970e23 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:47.442965 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082ca6d-3d6e-45d0-930d-be4ef7970e23 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:47.444431 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082ca6d-3d6e-45d0-930d-be4ef7970e23 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:47.460954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-a082ca6d-3d6e-45d0-930d-be4ef7970e23 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 02 20:39:47.460954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:39:47.460954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:39:47.460954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:39:47.460954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:39:47.460954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:39:47.460954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:39:47.460954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:39:47.460954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:39:47.460954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:39:47.460954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:39:47.460954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:39:47.460954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:39:47.460954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:39:47.460954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:39:47.460954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:39:47.462005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:39:47.462005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:39:47.462005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:39:47.462005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:39:47.462005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:39:47.462005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:39:47.462005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:39:47.462005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:39:47.462005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:39:47.462005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:39:47.462005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:39:47.462005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:39:47.462005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:39:47.462005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:39:47.462005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:39:47.462005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:39:47.462005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:39:47.462005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:39:47.463686 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:39:47.463686 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:39:47.463686 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:39:47.463686 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:39:47.463686 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:39:47.463686 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:39:47.463686 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:39:47.463686 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:39:47.463686 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 02 20:39:47.463686 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:39:47.463686 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 419/833] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:39:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:39:47.469017 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfedad-4549-4a1b-a28d-73389791831f None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:47.584842 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cfedad-4549-4a1b-a28d-73389791831f None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:47.623296 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49c3e2-f202-4b1b-960e-62d68cb10be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:47.623994 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49c3e2-f202-4b1b-960e-62d68cb10be6 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:47.624400 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49c3e2-f202-4b1b-960e-62d68cb10be6 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:47.624756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49c3e2-f202-4b1b-960e-62d68cb10be6 None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:47.625746 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49c3e2-f202-4b1b-960e-62d68cb10be6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:39:47.626059 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49c3e2-f202-4b1b-960e-62d68cb10be6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:47.627545 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49c3e2-f202-4b1b-960e-62d68cb10be6 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:47.647035 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 415/834] 10.222.0.57 () {56 vars in 1143 bytes} [Sat Jul 2 20:39:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:39:47.652752 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082ca6d-3d6e-45d0-930d-be4ef7970e23 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:47.766042 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082ca6d-3d6e-45d0-930d-be4ef7970e23 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:47.802599 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea5c0b-674c-4b83-82ff-0ce219403fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:47.803272 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea5c0b-674c-4b83-82ff-0ce219403fa4 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:47.803624 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea5c0b-674c-4b83-82ff-0ce219403fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:47.803940 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea5c0b-674c-4b83-82ff-0ce219403fa4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:47.833899 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:47.884785 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea5c0b-674c-4b83-82ff-0ce219403fa4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:47.884785 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea5c0b-674c-4b83-82ff-0ce219403fa4 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:48.006799 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 420/835] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:39:47 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 20:39:48.012973 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49c3e2-f202-4b1b-960e-62d68cb10be6 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:48.032047 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:48.117351 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49c3e2-f202-4b1b-960e-62d68cb10be6 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:48.164736 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9b61c-6087-4f49-ad01-c16ff2519625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:48.165459 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9b61c-6087-4f49-ad01-c16ff2519625 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:48.165740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9b61c-6087-4f49-ad01-c16ff2519625 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:48.166013 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9b61c-6087-4f49-ad01-c16ff2519625 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:48.176794 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9b61c-6087-4f49-ad01-c16ff2519625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:48.178407 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9b61c-6087-4f49-ad01-c16ff2519625 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:48.197884 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-7bd9b61c-6087-4f49-ad01-c16ff2519625 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:39:48.197884 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:39:48.197884 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:39:48.197884 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:39:48.197884 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:39:48.197884 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:39:48.197884 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:39:48.197884 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:39:48.197884 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:39:48.197884 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:39:48.197884 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:39:48.197884 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:39:48.197884 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:39:48.197884 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:39:48.197884 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:39:48.199001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:39:48.199001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:39:48.199001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:39:48.199001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:39:48.199001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:39:48.199001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:39:48.199001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:39:48.199001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:39:48.199001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:39:48.199001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:39:48.199001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:39:48.199001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:39:48.199001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:39:48.199001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:39:48.199001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:39:48.199001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:39:48.199001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:39:48.200353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:39:48.200353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:39:48.200353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:39:48.200353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:39:48.200353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 416/836] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:39:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:39:48.205575 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea5c0b-674c-4b83-82ff-0ce219403fa4 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:48.268307 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:48.312479 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea5c0b-674c-4b83-82ff-0ce219403fa4 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:48.347460 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54604dc5-cddc-41ad-a230-e16ddfc75d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:48.348131 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54604dc5-cddc-41ad-a230-e16ddfc75d97 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:48.348429 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54604dc5-cddc-41ad-a230-e16ddfc75d97 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:48.348703 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54604dc5-cddc-41ad-a230-e16ddfc75d97 None admin] PATH_INFO: `/v3/domains` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:48.349420 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54604dc5-cddc-41ad-a230-e16ddfc75d97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:39:48.349798 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54604dc5-cddc-41ad-a230-e16ddfc75d97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:48.351218 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54604dc5-cddc-41ad-a230-e16ddfc75d97 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:48.367601 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 421/837] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:39:48.373230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9b61c-6087-4f49-ad01-c16ff2519625 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:48.444100 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:48.476152 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9b61c-6087-4f49-ad01-c16ff2519625 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:48.512791 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470633b-f9a7-482d-908c-75286afe3054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:48.513599 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470633b-f9a7-482d-908c-75286afe3054 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:48.513883 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470633b-f9a7-482d-908c-75286afe3054 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:48.514157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4470633b-f9a7-482d-908c-75286afe3054 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:48.522681 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4470633b-f9a7-482d-908c-75286afe3054 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:48.524267 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4470633b-f9a7-482d-908c-75286afe3054 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:48.538541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-4470633b-f9a7-482d-908c-75286afe3054 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:39:48.538541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:39:48.538541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:39:48.538541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:39:48.538541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:39:48.538541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:39:48.538541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:39:48.538541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:39:48.538541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:39:48.538541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:39:48.538541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:39:48.538541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:39:48.538541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:39:48.538541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:39:48.538541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:39:48.539606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:39:48.539606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:39:48.539606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:39:48.539606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:39:48.539606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:39:48.539606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:39:48.539606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:39:48.539606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:39:48.539606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:39:48.539606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:39:48.539606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:39:48.539606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:39:48.539606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:39:48.539606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:39:48.539606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:39:48.539606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:39:48.539606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:39:48.540530 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:39:48.540530 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:39:48.540530 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:39:48.540530 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:39:48.540530 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:39:48.540530 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:39:48.540530 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:39:48.540530 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:39:48.540530 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 417/838] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:39:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:39:48.545590 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54604dc5-cddc-41ad-a230-e16ddfc75d97 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:48.655970 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54604dc5-cddc-41ad-a230-e16ddfc75d97 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:48.673917 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:48.692496 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8a686a-1a3e-4f6c-bac4-85093ac71b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:48.693390 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a686a-1a3e-4f6c-bac4-85093ac71b65 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:48.696544 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a686a-1a3e-4f6c-bac4-85093ac71b65 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:48.696544 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8a686a-1a3e-4f6c-bac4-85093ac71b65 None admin] PATH_INFO: `/v3/projects` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:48.696544 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a686a-1a3e-4f6c-bac4-85093ac71b65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:39:48.696544 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a686a-1a3e-4f6c-bac4-85093ac71b65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:48.696934 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8a686a-1a3e-4f6c-bac4-85093ac71b65 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:48.712754 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 422/839] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jul 2 20:39:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:39:48.717389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470633b-f9a7-482d-908c-75286afe3054 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:48.823259 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4470633b-f9a7-482d-908c-75286afe3054 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:48.861870 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:48.868086 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29ba961-ab89-43c9-be24-2da2579e5b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:48.868752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ba961-ab89-43c9-be24-2da2579e5b69 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:48.869033 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ba961-ab89-43c9-be24-2da2579e5b69 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:48.869306 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29ba961-ab89-43c9-be24-2da2579e5b69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:48.870139 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ba961-ab89-43c9-be24-2da2579e5b69 None admin] RBAC: Adding query filter params (role.id=09c018c7ef5249efb8f68eb74acafe13, scope.project.id=cd684ec63e1c4d61819302c837dd4349, user.id=f2377f751a584f678c0ddebc4de0ae44) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:39:48.870452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ba961-ab89-43c9-be24-2da2579e5b69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:48.871954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29ba961-ab89-43c9-be24-2da2579e5b69 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:48.877386 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 418/840] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:39:48 2022] GET /identity/v3/role_assignments?user.id=f2377f751a584f678c0ddebc4de0ae44&scope.project.id=cd684ec63e1c4d61819302c837dd4349&role.id=09c018c7ef5249efb8f68eb74acafe13 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:39:51.123616 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e0056-1ca9-4cd0-af42-b1a79f0d6de3 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:51.124179 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e0056-1ca9-4cd0-af42-b1a79f0d6de3 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:51.124422 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e0056-1ca9-4cd0-af42-b1a79f0d6de3 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:51.126172 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 423/841] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:39:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:39:51.131901 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6b811-617e-4406-9746-4ecab8962ebb None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:51.132401 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6b811-617e-4406-9746-4ecab8962ebb None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:51.132619 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6b811-617e-4406-9746-4ecab8962ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:51.151544 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-76f6b811-617e-4406-9746-4ecab8962ebb None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:39:51.152765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-76f6b811-617e-4406-9746-4ecab8962ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:39:51.237798 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 419/842] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:39:51 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 20:39:51.261871 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e0056-1ca9-4cd0-af42-b1a79f0d6de3 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:51.383116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e0056-1ca9-4cd0-af42-b1a79f0d6de3 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:51.423894 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477b2c9-16e4-4d2c-a885-6f9950c12d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:51.424863 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477b2c9-16e4-4d2c-a885-6f9950c12d61 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:51.425230 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477b2c9-16e4-4d2c-a885-6f9950c12d61 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:51.425503 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477b2c9-16e4-4d2c-a885-6f9950c12d61 None admin] PATH_INFO: `/v3/roles/service` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:51.437797 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2477b2c9-16e4-4d2c-a885-6f9950c12d61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:39:51.445745 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-2477b2c9-16e4-4d2c-a885-6f9950c12d61 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:39:51.445745 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:39:51.445745 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:39:51.445745 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:39:51.445745 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:39:51.445745 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:39:51.445745 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:39:51.445745 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:39:51.445745 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:39:51.445745 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:39:51.445745 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:39:51.445745 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:39:51.445745 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:39:51.445745 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:39:51.445745 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:39:51.445745 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:39:51.446954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:39:51.446954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:39:51.446954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:39:51.446954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:39:51.446954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:39:51.446954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:39:51.446954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:39:51.446954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:39:51.446954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:39:51.446954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:39:51.446954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:39:51.446954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:39:51.446954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:39:51.446954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:39:51.446954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:39:51.446954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:39:51.447904 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:39:51.447904 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:39:51.447904 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:39:51.447904 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:39:51.447904 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:39:51.447904 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:39:51.447904 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:39:51.447904 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:39:51.447904 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:39:51.447904 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:39:51.447904 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:39:51.447904 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:39:51.447904 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 424/843] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jul 2 20:39:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:39:51.453647 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6b811-617e-4406-9746-4ecab8962ebb None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:51.566930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6b811-617e-4406-9746-4ecab8962ebb None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:51.590697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:51.602130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc900a35-9c5e-4dd6-a7c5-a18aba0c04dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:51.602809 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc900a35-9c5e-4dd6-a7c5-a18aba0c04dd None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:51.603120 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc900a35-9c5e-4dd6-a7c5-a18aba0c04dd None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:51.603396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc900a35-9c5e-4dd6-a7c5-a18aba0c04dd None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:51.604140 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc900a35-9c5e-4dd6-a7c5-a18aba0c04dd None admin] RBAC: Adding query filter params (name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:39:51.604444 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc900a35-9c5e-4dd6-a7c5-a18aba0c04dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:51.605834 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc900a35-9c5e-4dd6-a7c5-a18aba0c04dd None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:51.614948 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 420/844] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jul 2 20:39:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:39:51.621549 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477b2c9-16e4-4d2c-a885-6f9950c12d61 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:51.664487 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:51.736291 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477b2c9-16e4-4d2c-a885-6f9950c12d61 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:51.772260 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31f1e4-ebf5-442a-925e-b5bee4a1a6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:51.773049 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31f1e4-ebf5-442a-925e-b5bee4a1a6bd None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:51.773329 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31f1e4-ebf5-442a-925e-b5bee4a1a6bd None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:51.773595 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31f1e4-ebf5-442a-925e-b5bee4a1a6bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:51.784572 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31f1e4-ebf5-442a-925e-b5bee4a1a6bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:51.786206 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31f1e4-ebf5-442a-925e-b5bee4a1a6bd None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:51.803796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-8c31f1e4-ebf5-442a-925e-b5bee4a1a6bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:39:51.803796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:39:51.803796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:39:51.803796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:39:51.803796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:39:51.803796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:39:51.803796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:39:51.803796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:39:51.803796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:39:51.803796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:39:51.803796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:39:51.803796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:39:51.803796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:39:51.803796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:39:51.803796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:39:51.804770 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:39:51.804770 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:39:51.804770 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:39:51.804770 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:39:51.804770 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:39:51.804770 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:39:51.804770 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:39:51.804770 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:39:51.804770 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:39:51.804770 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:39:51.804770 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:39:51.804770 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:39:51.804770 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:39:51.804770 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:39:51.804770 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:39:51.804770 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:39:51.804770 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:39:51.805688 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:39:51.805688 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:39:51.805688 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:39:51.805688 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:39:51.805688 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 425/845] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:39:51.811304 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc900a35-9c5e-4dd6-a7c5-a18aba0c04dd None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:51.920642 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc900a35-9c5e-4dd6-a7c5-a18aba0c04dd None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:51.958255 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc19887-70fd-4c15-aa70-d43443946f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:51.959047 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc19887-70fd-4c15-aa70-d43443946f46 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:51.959350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc19887-70fd-4c15-aa70-d43443946f46 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:51.959638 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc19887-70fd-4c15-aa70-d43443946f46 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:51.960435 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc19887-70fd-4c15-aa70-d43443946f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:39:51.960802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc19887-70fd-4c15-aa70-d43443946f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:51.962383 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc19887-70fd-4c15-aa70-d43443946f46 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:51.975046 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 421/846] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:39:51.981204 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31f1e4-ebf5-442a-925e-b5bee4a1a6bd None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:52.082123 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:52.092109 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31f1e4-ebf5-442a-925e-b5bee4a1a6bd None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:52.130398 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893bd15d-b50b-457f-9558-9839c28d331b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:52.131903 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bd15d-b50b-457f-9558-9839c28d331b None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:52.132187 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bd15d-b50b-457f-9558-9839c28d331b None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:52.132463 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893bd15d-b50b-457f-9558-9839c28d331b None admin] PATH_INFO: `/v3/users/placement` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:52.141196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893bd15d-b50b-457f-9558-9839c28d331b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:52.143040 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893bd15d-b50b-457f-9558-9839c28d331b None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:52.158785 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-893bd15d-b50b-457f-9558-9839c28d331b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 02 20:39:52.158785 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:39:52.158785 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:39:52.158785 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:39:52.158785 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:39:52.158785 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:39:52.158785 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:39:52.158785 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:39:52.158785 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:39:52.158785 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:39:52.158785 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:39:52.158785 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:39:52.158785 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:39:52.158785 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:39:52.158785 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:39:52.158785 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:39:52.159978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:39:52.159978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:39:52.159978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:39:52.159978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:39:52.159978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:39:52.159978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:39:52.159978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:39:52.159978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:39:52.159978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:39:52.159978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:39:52.159978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:39:52.159978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:39:52.159978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:39:52.159978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:39:52.159978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:39:52.159978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:39:52.159978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:39:52.159978 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:39:52.161270 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:39:52.161270 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:39:52.161270 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:39:52.161270 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:39:52.161270 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:39:52.161270 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:39:52.161270 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:39:52.161270 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:39:52.161270 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 02 20:39:52.161270 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:39:52.161270 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 426/847] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:39:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:39:52.165931 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc19887-70fd-4c15-aa70-d43443946f46 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:52.225504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:52.284899 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc19887-70fd-4c15-aa70-d43443946f46 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:52.325412 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447dba25-7bf1-4b4f-a64f-dd4ad41c08a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:52.326293 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dba25-7bf1-4b4f-a64f-dd4ad41c08a4 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:52.326664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dba25-7bf1-4b4f-a64f-dd4ad41c08a4 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:52.327025 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dba25-7bf1-4b4f-a64f-dd4ad41c08a4 None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:52.328500 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447dba25-7bf1-4b4f-a64f-dd4ad41c08a4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:39:52.328806 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447dba25-7bf1-4b4f-a64f-dd4ad41c08a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:52.330236 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447dba25-7bf1-4b4f-a64f-dd4ad41c08a4 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:52.347821 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 422/848] 10.222.0.57 () {56 vars in 1143 bytes} [Sat Jul 2 20:39:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:39:52.355780 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893bd15d-b50b-457f-9558-9839c28d331b None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:52.481740 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893bd15d-b50b-457f-9558-9839c28d331b None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:52.520061 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c16e54-d40c-49b6-ad8b-90653518e546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:52.520859 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c16e54-d40c-49b6-ad8b-90653518e546 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:52.521139 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c16e54-d40c-49b6-ad8b-90653518e546 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:52.521410 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c16e54-d40c-49b6-ad8b-90653518e546 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:52.531986 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c16e54-d40c-49b6-ad8b-90653518e546 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:52.533698 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c16e54-d40c-49b6-ad8b-90653518e546 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:52.554573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-23c16e54-d40c-49b6-ad8b-90653518e546 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:39:52.554573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:39:52.554573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:39:52.554573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:39:52.554573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:39:52.554573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:39:52.554573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:39:52.554573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:39:52.554573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:39:52.554573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:39:52.554573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:39:52.554573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:39:52.554573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:39:52.554573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:39:52.554573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:39:52.556639 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:39:52.556639 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:39:52.556639 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:39:52.556639 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:39:52.556639 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:39:52.556639 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:39:52.556639 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:39:52.556639 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:39:52.556639 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:39:52.556639 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:39:52.556639 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:39:52.556639 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:39:52.556639 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:39:52.556639 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:39:52.556639 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:39:52.556639 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:39:52.556639 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:39:52.558545 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:39:52.558545 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:39:52.558545 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:39:52.558545 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:39:52.558545 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 427/849] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:39:52.564500 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447dba25-7bf1-4b4f-a64f-dd4ad41c08a4 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:52.681762 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447dba25-7bf1-4b4f-a64f-dd4ad41c08a4 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:52.684250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:52.724308 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137575a-99c2-43ea-a715-fdd325973cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:52.724996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137575a-99c2-43ea-a715-fdd325973cd5 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:52.725260 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137575a-99c2-43ea-a715-fdd325973cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:52.725530 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137575a-99c2-43ea-a715-fdd325973cd5 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:52.726251 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137575a-99c2-43ea-a715-fdd325973cd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:39:52.726555 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137575a-99c2-43ea-a715-fdd325973cd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:52.727991 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137575a-99c2-43ea-a715-fdd325973cd5 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:52.739680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 423/850] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:39:52.745286 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c16e54-d40c-49b6-ad8b-90653518e546 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:52.748677 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:52.849345 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c16e54-d40c-49b6-ad8b-90653518e546 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:52.882962 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94b2bd-a748-45a0-874b-c7cb8b1247d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:52.883783 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94b2bd-a748-45a0-874b-c7cb8b1247d1 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:52.884063 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94b2bd-a748-45a0-874b-c7cb8b1247d1 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:52.884310 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a94b2bd-a748-45a0-874b-c7cb8b1247d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:52.892172 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94b2bd-a748-45a0-874b-c7cb8b1247d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:52.893638 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a94b2bd-a748-45a0-874b-c7cb8b1247d1 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:52.915750 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-0a94b2bd-a748-45a0-874b-c7cb8b1247d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:39:52.915750 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:39:52.915750 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:39:52.915750 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:39:52.915750 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:39:52.915750 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:39:52.915750 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:39:52.915750 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:39:52.915750 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:39:52.915750 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:39:52.915750 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:39:52.915750 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:39:52.915750 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:39:52.915750 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:39:52.915750 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:39:52.916851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:39:52.916851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:39:52.916851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:39:52.916851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:39:52.916851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:39:52.916851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:39:52.916851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:39:52.916851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:39:52.916851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:39:52.916851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:39:52.916851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:39:52.916851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:39:52.916851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:39:52.916851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:39:52.916851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:39:52.916851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:39:52.916851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:39:52.917849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:39:52.917849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:39:52.917849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:39:52.917849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:39:52.917849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:39:52.917849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:39:52.917849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:39:52.917849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:39:52.917849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 428/851] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:39:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:39:52.923191 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137575a-99c2-43ea-a715-fdd325973cd5 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:53.032047 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137575a-99c2-43ea-a715-fdd325973cd5 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:53.069279 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eec979-0b74-48d6-91b5-6a5378a6e7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:53.069965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eec979-0b74-48d6-91b5-6a5378a6e7b1 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:53.070244 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eec979-0b74-48d6-91b5-6a5378a6e7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:53.070516 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eec979-0b74-48d6-91b5-6a5378a6e7b1 None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:53.071319 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eec979-0b74-48d6-91b5-6a5378a6e7b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:39:53.071625 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eec979-0b74-48d6-91b5-6a5378a6e7b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:53.073058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eec979-0b74-48d6-91b5-6a5378a6e7b1 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:53.086329 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 424/852] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jul 2 20:39:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:39:53.092410 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94b2bd-a748-45a0-874b-c7cb8b1247d1 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:53.156484 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:53.197788 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a94b2bd-a748-45a0-874b-c7cb8b1247d1 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:53.233160 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69b1b8-806d-4a9c-8b01-419efe5309ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:53.234232 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69b1b8-806d-4a9c-8b01-419efe5309ca None admin] REQUEST_METHOD: `PUT` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:53.234467 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69b1b8-806d-4a9c-8b01-419efe5309ca None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:53.234718 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69b1b8-806d-4a9c-8b01-419efe5309ca None admin] PATH_INFO: `/v3/projects/cd684ec63e1c4d61819302c837dd4349/users/f2377f751a584f678c0ddebc4de0ae44/roles/09c018c7ef5249efb8f68eb74acafe13` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:53.251279 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69b1b8-806d-4a9c-8b01-419efe5309ca None admin] RBAC: Authorizing `identity:create_grant(project_id=cd684ec63e1c4d61819302c837dd4349, user_id=f2377f751a584f678c0ddebc4de0ae44, role_id=09c018c7ef5249efb8f68eb74acafe13)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:53.252875 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69b1b8-806d-4a9c-8b01-419efe5309ca None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:53.267917 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 429/853] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jul 2 20:39:53 2022] PUT /identity/v3/projects/cd684ec63e1c4d61819302c837dd4349/users/f2377f751a584f678c0ddebc4de0ae44/roles/09c018c7ef5249efb8f68eb74acafe13 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:39:55.811488 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac328ed-9b3b-4501-93c8-c8f872809f6b None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:55.812302 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac328ed-9b3b-4501-93c8-c8f872809f6b None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:55.812587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac328ed-9b3b-4501-93c8-c8f872809f6b None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:55.814186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 425/854] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:39:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:39:55.819246 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca512a85-c9fa-475c-89aa-4286a815feaa None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:55.819630 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca512a85-c9fa-475c-89aa-4286a815feaa None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:55.819797 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca512a85-c9fa-475c-89aa-4286a815feaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:55.839108 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-ca512a85-c9fa-475c-89aa-4286a815feaa None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:39:55.840281 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-ca512a85-c9fa-475c-89aa-4286a815feaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:39:55.915021 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 430/855] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:39:55 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:39:55.941524 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac328ed-9b3b-4501-93c8-c8f872809f6b None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:55.968671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:56.055535 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac328ed-9b3b-4501-93c8-c8f872809f6b None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:56.093223 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823bb51-a8fa-481b-bc28-f0a9a63e510f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:56.094239 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823bb51-a8fa-481b-bc28-f0a9a63e510f None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:56.094526 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823bb51-a8fa-481b-bc28-f0a9a63e510f None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:56.094808 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823bb51-a8fa-481b-bc28-f0a9a63e510f None admin] PATH_INFO: `/v3/roles/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:56.106936 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823bb51-a8fa-481b-bc28-f0a9a63e510f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:39:56.115855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-a823bb51-a8fa-481b-bc28-f0a9a63e510f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:39:56.115855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:39:56.115855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:39:56.115855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:39:56.115855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:39:56.115855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:39:56.115855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:39:56.115855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:39:56.115855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:39:56.115855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:39:56.115855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:39:56.115855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:39:56.115855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:39:56.115855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:39:56.115855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:39:56.115855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:39:56.116998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:39:56.116998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:39:56.116998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:39:56.116998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:39:56.116998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:39:56.116998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:39:56.116998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:39:56.116998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:39:56.116998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:39:56.116998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:39:56.116998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:39:56.116998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:39:56.116998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:39:56.116998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:39:56.116998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:39:56.116998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:39:56.118084 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:39:56.118084 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:39:56.118084 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:39:56.118084 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:39:56.118084 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:39:56.118084 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:39:56.118084 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:39:56.118084 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:39:56.118084 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:39:56.118084 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:39:56.118084 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 02 20:39:56.118084 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:39:56.118084 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 426/856] 10.222.0.57 () {56 vars in 1102 bytes} [Sat Jul 2 20:39:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:39:56.123795 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca512a85-c9fa-475c-89aa-4286a815feaa None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:56.169276 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:56.236197 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca512a85-c9fa-475c-89aa-4286a815feaa None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:56.273347 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8172f-ac8c-4f88-95f7-658e4b27aeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:56.274133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8172f-ac8c-4f88-95f7-658e4b27aeb7 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:56.274455 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8172f-ac8c-4f88-95f7-658e4b27aeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:56.274764 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e8172f-ac8c-4f88-95f7-658e4b27aeb7 None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:56.275598 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8172f-ac8c-4f88-95f7-658e4b27aeb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:39:56.275915 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8172f-ac8c-4f88-95f7-658e4b27aeb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:56.277380 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e8172f-ac8c-4f88-95f7-658e4b27aeb7 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:56.286512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 431/857] 10.222.0.57 () {56 vars in 1103 bytes} [Sat Jul 2 20:39:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:39:56.292454 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823bb51-a8fa-481b-bc28-f0a9a63e510f None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:56.392312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:56.410967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823bb51-a8fa-481b-bc28-f0a9a63e510f None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:56.450250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88de7d1-c294-4844-9601-d536548b9685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:56.451189 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88de7d1-c294-4844-9601-d536548b9685 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:56.451528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88de7d1-c294-4844-9601-d536548b9685 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:56.451826 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88de7d1-c294-4844-9601-d536548b9685 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:56.464644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88de7d1-c294-4844-9601-d536548b9685 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:56.466227 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88de7d1-c294-4844-9601-d536548b9685 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:56.484052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-b88de7d1-c294-4844-9601-d536548b9685 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:39:56.484052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:39:56.484052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:39:56.484052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:39:56.484052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:39:56.484052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:39:56.484052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:39:56.484052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:39:56.484052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:39:56.484052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:39:56.484052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:39:56.484052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:39:56.484052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:39:56.484052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:39:56.484052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:39:56.485203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:39:56.485203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:39:56.485203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:39:56.485203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:39:56.485203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:39:56.485203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:39:56.485203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:39:56.485203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:39:56.485203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:39:56.485203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:39:56.485203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:39:56.485203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:39:56.485203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:39:56.485203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:39:56.485203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:39:56.485203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:39:56.485203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:39:56.486099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:39:56.486099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:39:56.486099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:39:56.486099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:39:56.486099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 427/858] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:39:56.491577 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8172f-ac8c-4f88-95f7-658e4b27aeb7 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:56.604150 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e8172f-ac8c-4f88-95f7-658e4b27aeb7 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:56.606490 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:56.645275 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e844c3e-0926-48b5-9087-7fe1bed47f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:56.645928 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e844c3e-0926-48b5-9087-7fe1bed47f36 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:56.646201 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e844c3e-0926-48b5-9087-7fe1bed47f36 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:56.646463 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e844c3e-0926-48b5-9087-7fe1bed47f36 None admin] PATH_INFO: `/v3/domains` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:56.647285 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e844c3e-0926-48b5-9087-7fe1bed47f36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:39:56.647589 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e844c3e-0926-48b5-9087-7fe1bed47f36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:56.648968 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e844c3e-0926-48b5-9087-7fe1bed47f36 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:56.660983 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 432/859] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:39:56.666661 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88de7d1-c294-4844-9601-d536548b9685 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:56.777148 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88de7d1-c294-4844-9601-d536548b9685 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:56.813196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc17fb3-6f4a-464a-8e11-7dcb334d680c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:56.814070 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc17fb3-6f4a-464a-8e11-7dcb334d680c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:56.814329 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc17fb3-6f4a-464a-8e11-7dcb334d680c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:56.814613 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc17fb3-6f4a-464a-8e11-7dcb334d680c None admin] PATH_INFO: `/v3/users/placement` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:56.817577 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:56.823154 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc17fb3-6f4a-464a-8e11-7dcb334d680c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:56.824891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc17fb3-6f4a-464a-8e11-7dcb334d680c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:56.842134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-1bc17fb3-6f4a-464a-8e11-7dcb334d680c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 02 20:39:56.842134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:39:56.842134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:39:56.842134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:39:56.842134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:39:56.842134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:39:56.842134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:39:56.842134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:39:56.842134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:39:56.842134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:39:56.842134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:39:56.842134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:39:56.842134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:39:56.842134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:39:56.842134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:39:56.842134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:39:56.843368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:39:56.843368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:39:56.843368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:39:56.843368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:39:56.843368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:39:56.843368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:39:56.843368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:39:56.843368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:39:56.843368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:39:56.843368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:39:56.843368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:39:56.843368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:39:56.843368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:39:56.843368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:39:56.843368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:39:56.843368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:39:56.843368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:39:56.843368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:39:56.844578 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:39:56.844578 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:39:56.844578 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:39:56.844578 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:39:56.844578 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:39:56.844578 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:39:56.844578 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:39:56.844578 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:39:56.844578 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 02 20:39:56.844578 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:39:56.844578 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 428/860] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:39:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:39:56.849493 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e844c3e-0926-48b5-9087-7fe1bed47f36 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:56.953491 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e844c3e-0926-48b5-9087-7fe1bed47f36 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:56.989636 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22f942-63c7-4946-8ab7-94d50586b7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:56.990305 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22f942-63c7-4946-8ab7-94d50586b7b0 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:56.990583 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22f942-63c7-4946-8ab7-94d50586b7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:56.990851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22f942-63c7-4946-8ab7-94d50586b7b0 None admin] PATH_INFO: `/v3/users` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:56.991711 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22f942-63c7-4946-8ab7-94d50586b7b0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:39:56.992018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22f942-63c7-4946-8ab7-94d50586b7b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:56.993460 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22f942-63c7-4946-8ab7-94d50586b7b0 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:57.013726 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 433/861] 10.222.0.57 () {56 vars in 1143 bytes} [Sat Jul 2 20:39:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 02 20:39:57.019112 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc17fb3-6f4a-464a-8e11-7dcb334d680c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:57.126322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc17fb3-6f4a-464a-8e11-7dcb334d680c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:57.160540 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a0b28-23fd-4428-9565-96e2a866207c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:57.161200 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a0b28-23fd-4428-9565-96e2a866207c None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:57.161481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a0b28-23fd-4428-9565-96e2a866207c None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:57.161755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a0b28-23fd-4428-9565-96e2a866207c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:57.228432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:57.236595 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a0b28-23fd-4428-9565-96e2a866207c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:57.238302 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a0b28-23fd-4428-9565-96e2a866207c None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:57.356031 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 429/862] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:39:57 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 20:39:57.358134 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22f942-63c7-4946-8ab7-94d50586b7b0 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:57.386735 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:57.469059 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22f942-63c7-4946-8ab7-94d50586b7b0 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:57.504403 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdb1e1-450d-481c-bf98-6df61b1f342c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:57.505134 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdb1e1-450d-481c-bf98-6df61b1f342c None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:57.505407 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdb1e1-450d-481c-bf98-6df61b1f342c None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:57.505670 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebdb1e1-450d-481c-bf98-6df61b1f342c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:57.515758 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdb1e1-450d-481c-bf98-6df61b1f342c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:57.517206 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebdb1e1-450d-481c-bf98-6df61b1f342c None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:57.534528 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-1ebdb1e1-450d-481c-bf98-6df61b1f342c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:39:57.534528 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:39:57.534528 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:39:57.534528 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:39:57.534528 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:39:57.534528 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:39:57.534528 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:39:57.534528 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:39:57.534528 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:39:57.534528 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:39:57.534528 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:39:57.534528 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:39:57.534528 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:39:57.534528 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:39:57.534528 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:39:57.535672 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:39:57.535672 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:39:57.535672 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:39:57.535672 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:39:57.535672 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:39:57.535672 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:39:57.535672 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:39:57.535672 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:39:57.535672 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:39:57.535672 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:39:57.535672 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:39:57.535672 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:39:57.535672 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:39:57.535672 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:39:57.535672 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:39:57.535672 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:39:57.535672 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:39:57.537029 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:39:57.537029 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:39:57.537029 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:39:57.537029 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:39:57.537029 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 434/863] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:39:57.541495 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a0b28-23fd-4428-9565-96e2a866207c None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:57.640001 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:57.646097 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a0b28-23fd-4428-9565-96e2a866207c None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:57.682484 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10d71f-987e-4577-ad31-d25ae4bb0400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:57.683180 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10d71f-987e-4577-ad31-d25ae4bb0400 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:57.683460 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10d71f-987e-4577-ad31-d25ae4bb0400 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:57.683732 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10d71f-987e-4577-ad31-d25ae4bb0400 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:57.684442 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10d71f-987e-4577-ad31-d25ae4bb0400 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:39:57.684747 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10d71f-987e-4577-ad31-d25ae4bb0400 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:57.686151 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10d71f-987e-4577-ad31-d25ae4bb0400 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:57.701256 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 430/864] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:39:57.708558 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdb1e1-450d-481c-bf98-6df61b1f342c None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:57.791698 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:57.820685 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebdb1e1-450d-481c-bf98-6df61b1f342c None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:57.860692 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5675af-3f4c-45e3-a6e3-a35aacdfddf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:57.861865 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5675af-3f4c-45e3-a6e3-a35aacdfddf2 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:57.862223 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5675af-3f4c-45e3-a6e3-a35aacdfddf2 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:57.862689 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5675af-3f4c-45e3-a6e3-a35aacdfddf2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:57.872071 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5675af-3f4c-45e3-a6e3-a35aacdfddf2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:57.873846 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5675af-3f4c-45e3-a6e3-a35aacdfddf2 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:57.890228 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-9a5675af-3f4c-45e3-a6e3-a35aacdfddf2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:39:57.890228 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:39:57.890228 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:39:57.890228 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:39:57.890228 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:39:57.890228 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:39:57.890228 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:39:57.890228 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:39:57.890228 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:39:57.890228 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:39:57.890228 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:39:57.890228 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:39:57.890228 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:39:57.890228 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:39:57.890228 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:39:57.891569 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:39:57.891569 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:39:57.891569 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:39:57.891569 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:39:57.891569 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:39:57.891569 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:39:57.891569 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:39:57.891569 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:39:57.891569 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:39:57.891569 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:39:57.891569 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:39:57.891569 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:39:57.891569 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:39:57.891569 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:39:57.891569 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:39:57.891569 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:39:57.891569 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:39:57.892805 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:39:57.892805 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:39:57.892805 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:39:57.892805 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:39:57.892805 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:39:57.892805 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:39:57.892805 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:39:57.892805 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:39:57.892805 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 435/865] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:39:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:39:57.898029 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10d71f-987e-4577-ad31-d25ae4bb0400 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:58.010289 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10d71f-987e-4577-ad31-d25ae4bb0400 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:58.049058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a3576-271b-4ef3-b16f-2c9350009a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:58.049795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a3576-271b-4ef3-b16f-2c9350009a39 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:58.050056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a3576-271b-4ef3-b16f-2c9350009a39 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:58.050398 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a3576-271b-4ef3-b16f-2c9350009a39 None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:58.051253 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a3576-271b-4ef3-b16f-2c9350009a39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:39:58.051572 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a3576-271b-4ef3-b16f-2c9350009a39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:58.053063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a3576-271b-4ef3-b16f-2c9350009a39 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:58.074501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 431/866] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jul 2 20:39:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:39:58.075528 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5675af-3f4c-45e3-a6e3-a35aacdfddf2 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:39:58.188548 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5675af-3f4c-45e3-a6e3-a35aacdfddf2 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:39:58.225865 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a75b21f-f2b0-41fd-a32a-eebaf61100d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:39:58.226564 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75b21f-f2b0-41fd-a32a-eebaf61100d4 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:39:58.226834 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75b21f-f2b0-41fd-a32a-eebaf61100d4 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:39:58.227167 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75b21f-f2b0-41fd-a32a-eebaf61100d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:39:58.228035 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75b21f-f2b0-41fd-a32a-eebaf61100d4 None admin] RBAC: Adding query filter params (role.id=09c018c7ef5249efb8f68eb74acafe13, scope.project.id=cd684ec63e1c4d61819302c837dd4349, user.id=f2377f751a584f678c0ddebc4de0ae44) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:39:58.228397 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75b21f-f2b0-41fd-a32a-eebaf61100d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:39:58.230004 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a75b21f-f2b0-41fd-a32a-eebaf61100d4 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:39:58.231942 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:39:58.237504 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 436/867] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:39:58 2022] GET /identity/v3/role_assignments?user.id=f2377f751a584f678c0ddebc4de0ae44&scope.project.id=cd684ec63e1c4d61819302c837dd4349&role.id=09c018c7ef5249efb8f68eb74acafe13 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:40:00.921285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5e05f-e29e-45e6-8d2e-8d37cda89386 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:00.921908 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5e05f-e29e-45e6-8d2e-8d37cda89386 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:00.921908 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5e05f-e29e-45e6-8d2e-8d37cda89386 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:00.923267 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 432/868] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:40:00.928554 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cc7cc-a761-4f3f-8dd5-7b050213aaf5 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:00.929350 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cc7cc-a761-4f3f-8dd5-7b050213aaf5 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:00.929350 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cc7cc-a761-4f3f-8dd5-7b050213aaf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:00.948222 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-ad1cc7cc-a761-4f3f-8dd5-7b050213aaf5 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:40:00.949424 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-ad1cc7cc-a761-4f3f-8dd5-7b050213aaf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:40:01.023006 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 437/869] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:40:00 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 02 20:40:01.047757 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5e05f-e29e-45e6-8d2e-8d37cda89386 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:01.066111 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:01.163012 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5e05f-e29e-45e6-8d2e-8d37cda89386 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:01.200522 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc9bc6-0d57-421a-98c0-557c5bbe5363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:01.201323 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc9bc6-0d57-421a-98c0-557c5bbe5363 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:01.201612 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc9bc6-0d57-421a-98c0-557c5bbe5363 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:01.201894 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccc9bc6-0d57-421a-98c0-557c5bbe5363 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:01.214504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccc9bc6-0d57-421a-98c0-557c5bbe5363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:40:01.222437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-3ccc9bc6-0d57-421a-98c0-557c5bbe5363 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:40:01.222437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:40:01.222437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:40:01.222437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:40:01.222437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:40:01.222437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:40:01.222437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:40:01.222437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:40:01.222437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:40:01.222437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:40:01.222437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:40:01.222437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:40:01.222437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:40:01.222437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:40:01.222437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:40:01.222437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:40:01.223741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:40:01.223741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:40:01.223741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:40:01.223741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:40:01.223741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:40:01.223741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:40:01.223741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:40:01.223741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:40:01.223741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:40:01.223741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:40:01.223741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:40:01.223741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:40:01.223741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:40:01.223741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:40:01.223741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:40:01.223741 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:40:01.224751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:40:01.224751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:40:01.224751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:40:01.224751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:40:01.224751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:40:01.224751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:40:01.224751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:40:01.224751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:40:01.224751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:40:01.224751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:40:01.224751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:40:01.224751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:40:01.224751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 433/870] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jul 2 20:40:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:40:01.230118 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cc7cc-a761-4f3f-8dd5-7b050213aaf5 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:01.333894 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cc7cc-a761-4f3f-8dd5-7b050213aaf5 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:01.364544 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:01.374182 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc01b1e-e968-4963-acd0-045e35c04560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:01.375023 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc01b1e-e968-4963-acd0-045e35c04560 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:01.375318 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc01b1e-e968-4963-acd0-045e35c04560 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:01.375585 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc01b1e-e968-4963-acd0-045e35c04560 None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:01.376334 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc01b1e-e968-4963-acd0-045e35c04560 None admin] RBAC: Adding query filter params (name=admin) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:40:01.376637 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc01b1e-e968-4963-acd0-045e35c04560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:01.378127 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc01b1e-e968-4963-acd0-045e35c04560 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:01.387043 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 438/871] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:40:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:40:01.393800 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc9bc6-0d57-421a-98c0-557c5bbe5363 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:01.479755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:01.507859 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccc9bc6-0d57-421a-98c0-557c5bbe5363 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:01.543441 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18f006-5b88-4917-bb74-1182eb283178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:01.544242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18f006-5b88-4917-bb74-1182eb283178 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:01.544512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18f006-5b88-4917-bb74-1182eb283178 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:01.544835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18f006-5b88-4917-bb74-1182eb283178 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:01.555715 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18f006-5b88-4917-bb74-1182eb283178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:01.557179 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18f006-5b88-4917-bb74-1182eb283178 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:01.574856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-9b18f006-5b88-4917-bb74-1182eb283178 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:40:01.574856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:40:01.574856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:40:01.574856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:40:01.574856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:40:01.574856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:40:01.574856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:40:01.574856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:40:01.574856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:40:01.574856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:40:01.574856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:40:01.574856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:40:01.574856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:40:01.574856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:40:01.574856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:40:01.576040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:40:01.576040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:40:01.576040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:40:01.576040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:40:01.576040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:40:01.576040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:40:01.576040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:40:01.576040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:40:01.576040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:40:01.576040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:40:01.576040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:40:01.576040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:40:01.576040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:40:01.576040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:40:01.576040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:40:01.576040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:40:01.576040 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:40:01.576986 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:40:01.576986 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:40:01.576986 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:40:01.576986 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:40:01.576986 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 434/872] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 02 20:40:01.582377 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc01b1e-e968-4963-acd0-045e35c04560 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:01.707393 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc01b1e-e968-4963-acd0-045e35c04560 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:01.745004 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0327e4-0ec2-4d1c-90bf-d69243896aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:01.745677 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0327e4-0ec2-4d1c-90bf-d69243896aec None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:01.745964 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0327e4-0ec2-4d1c-90bf-d69243896aec None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:01.746239 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0327e4-0ec2-4d1c-90bf-d69243896aec None admin] PATH_INFO: `/v3/domains` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:01.747021 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0327e4-0ec2-4d1c-90bf-d69243896aec None admin] RBAC: Adding query filter params (name=Default) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:40:01.747330 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0327e4-0ec2-4d1c-90bf-d69243896aec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:01.748745 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0327e4-0ec2-4d1c-90bf-d69243896aec None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:01.760596 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 439/873] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:40:01.766682 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18f006-5b88-4917-bb74-1182eb283178 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:01.876646 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18f006-5b88-4917-bb74-1182eb283178 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:01.909449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:01.918614 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d3dbc-6dbc-4191-b1aa-b5ffbf5f8e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:01.919474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d3dbc-6dbc-4191-b1aa-b5ffbf5f8e78 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:01.919800 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d3dbc-6dbc-4191-b1aa-b5ffbf5f8e78 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:01.920075 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0d3dbc-6dbc-4191-b1aa-b5ffbf5f8e78 None admin] PATH_INFO: `/v3/users/placement` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:01.928050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d3dbc-6dbc-4191-b1aa-b5ffbf5f8e78 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:01.929570 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0d3dbc-6dbc-4191-b1aa-b5ffbf5f8e78 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:01.944369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-2b0d3dbc-6dbc-4191-b1aa-b5ffbf5f8e78 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 02 20:40:01.944369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:40:01.944369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:40:01.944369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:40:01.944369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:40:01.944369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:40:01.944369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:40:01.944369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:40:01.944369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:40:01.944369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:40:01.944369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:40:01.944369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:40:01.944369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:40:01.944369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:40:01.944369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:40:01.944369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:40:01.945666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:40:01.945666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:40:01.945666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:40:01.945666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:40:01.945666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:40:01.945666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:40:01.945666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:40:01.945666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:40:01.945666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:40:01.945666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:40:01.945666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:40:01.945666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:40:01.945666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:40:01.945666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:40:01.945666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:40:01.945666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:40:01.945666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:40:01.945666 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:40:01.946873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:40:01.946873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:40:01.946873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:40:01.946873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:40:01.946873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:40:01.946873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:40:01.946873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:40:01.946873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:40:01.946873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 02 20:40:01.946873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:40:01.946873 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 435/874] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:40:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:40:01.951761 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0327e4-0ec2-4d1c-90bf-d69243896aec None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:02.004953 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:02.061050 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0327e4-0ec2-4d1c-90bf-d69243896aec None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:02.099677 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5932509-505c-49f8-ab90-b4c9d46de334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:02.100363 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5932509-505c-49f8-ab90-b4c9d46de334 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:02.100640 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5932509-505c-49f8-ab90-b4c9d46de334 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:02.100913 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5932509-505c-49f8-ab90-b4c9d46de334 None admin] PATH_INFO: `/v3/users` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:02.101757 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5932509-505c-49f8-ab90-b4c9d46de334 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:40:02.102067 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5932509-505c-49f8-ab90-b4c9d46de334 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:02.103792 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5932509-505c-49f8-ab90-b4c9d46de334 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:02.124063 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 440/875] 10.222.0.57 () {56 vars in 1143 bytes} [Sat Jul 2 20:40:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:40:02.130005 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d3dbc-6dbc-4191-b1aa-b5ffbf5f8e78 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:02.236611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0d3dbc-6dbc-4191-b1aa-b5ffbf5f8e78 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:02.270950 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4556975-91cf-4f8e-85ca-4e3ce0f85261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:02.271544 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4556975-91cf-4f8e-85ca-4e3ce0f85261 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:02.271824 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4556975-91cf-4f8e-85ca-4e3ce0f85261 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:02.272094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4556975-91cf-4f8e-85ca-4e3ce0f85261 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:02.330354 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:02.343778 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4556975-91cf-4f8e-85ca-4e3ce0f85261 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:02.345265 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4556975-91cf-4f8e-85ca-4e3ce0f85261 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:02.477053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 436/876] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:40:02 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 20:40:02.483926 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5932509-505c-49f8-ab90-b4c9d46de334 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:02.592434 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5932509-505c-49f8-ab90-b4c9d46de334 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:02.602264 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:02.628897 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9ecf3-5699-4a62-a4da-e759a2c8f762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:02.629818 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9ecf3-5699-4a62-a4da-e759a2c8f762 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:02.630127 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9ecf3-5699-4a62-a4da-e759a2c8f762 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:02.630456 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd9ecf3-5699-4a62-a4da-e759a2c8f762 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:02.640872 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9ecf3-5699-4a62-a4da-e759a2c8f762 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:02.642377 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd9ecf3-5699-4a62-a4da-e759a2c8f762 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:02.661328 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-7dd9ecf3-5699-4a62-a4da-e759a2c8f762 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:40:02.661328 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:40:02.661328 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:40:02.661328 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:40:02.661328 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:40:02.661328 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:40:02.661328 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:40:02.661328 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:40:02.661328 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:40:02.661328 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:40:02.661328 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:40:02.661328 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:40:02.661328 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:40:02.661328 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:40:02.661328 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:40:02.662407 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:40:02.662407 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:40:02.662407 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:40:02.662407 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:40:02.662407 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:40:02.662407 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:40:02.662407 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:40:02.662407 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:40:02.662407 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:40:02.662407 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:40:02.662407 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:40:02.662407 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:40:02.662407 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:40:02.662407 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:40:02.662407 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:40:02.662407 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:40:02.662407 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:40:02.663464 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:40:02.663464 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:40:02.663464 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:40:02.663464 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:40:02.663464 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 441/877] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:40:02.669265 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4556975-91cf-4f8e-85ca-4e3ce0f85261 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:02.767547 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:02.786808 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4556975-91cf-4f8e-85ca-4e3ce0f85261 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:02.827750 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fd6a6-f08a-486a-8652-15d0b0b26af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:02.828426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fd6a6-f08a-486a-8652-15d0b0b26af8 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:02.828765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fd6a6-f08a-486a-8652-15d0b0b26af8 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:02.828984 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fd6a6-f08a-486a-8652-15d0b0b26af8 None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:02.829787 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786fd6a6-f08a-486a-8652-15d0b0b26af8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:40:02.830129 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786fd6a6-f08a-486a-8652-15d0b0b26af8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:02.831547 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786fd6a6-f08a-486a-8652-15d0b0b26af8 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:02.845064 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 437/878] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:40:02.851269 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9ecf3-5699-4a62-a4da-e759a2c8f762 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:02.955663 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd9ecf3-5699-4a62-a4da-e759a2c8f762 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:02.989182 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b2666-1193-429f-8933-2d7f655005b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:02.989974 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b2666-1193-429f-8933-2d7f655005b4 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:02.990245 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b2666-1193-429f-8933-2d7f655005b4 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:02.990510 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b2666-1193-429f-8933-2d7f655005b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:02.997475 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b2666-1193-429f-8933-2d7f655005b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:02.998989 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b2666-1193-429f-8933-2d7f655005b4 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:03.013225 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-b65b2666-1193-429f-8933-2d7f655005b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:40:03.013225 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:40:03.013225 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:40:03.013225 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:40:03.013225 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:40:03.013225 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:40:03.013225 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:40:03.013225 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:40:03.013225 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:40:03.013225 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:40:03.013225 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:40:03.013225 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:40:03.013225 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:40:03.013225 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:40:03.013225 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:40:03.014342 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:40:03.014342 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:40:03.014342 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:40:03.014342 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:40:03.014342 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:40:03.014342 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:40:03.014342 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:40:03.014342 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:40:03.014342 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:40:03.014342 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:40:03.014342 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:40:03.014342 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:40:03.014342 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:40:03.014342 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:40:03.014342 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:40:03.014342 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:40:03.014342 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:40:03.015446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:40:03.015446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:40:03.015446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:40:03.015446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:40:03.015446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:40:03.015446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:40:03.015446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:40:03.015446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:40:03.015446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 442/879] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:40:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:40:03.020638 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fd6a6-f08a-486a-8652-15d0b0b26af8 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:03.149609 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786fd6a6-f08a-486a-8652-15d0b0b26af8 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:03.186934 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a67ff3-e6b5-49b6-b334-af508cec4eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:03.187669 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a67ff3-e6b5-49b6-b334-af508cec4eb9 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:03.187947 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a67ff3-e6b5-49b6-b334-af508cec4eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:03.188220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a67ff3-e6b5-49b6-b334-af508cec4eb9 None admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:03.189017 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a67ff3-e6b5-49b6-b334-af508cec4eb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:40:03.189324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a67ff3-e6b5-49b6-b334-af508cec4eb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:03.190808 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a67ff3-e6b5-49b6-b334-af508cec4eb9 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:03.206425 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 438/880] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jul 2 20:40:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:40:03.212937 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b2666-1193-429f-8933-2d7f655005b4 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:03.238753 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:03.323655 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b2666-1193-429f-8933-2d7f655005b4 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:03.363238 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3fea50-10de-4d49-83b8-734c99ce78b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:03.364000 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fea50-10de-4d49-83b8-734c99ce78b8 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:03.364308 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fea50-10de-4d49-83b8-734c99ce78b8 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:03.364548 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3fea50-10de-4d49-83b8-734c99ce78b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:03.365377 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3fea50-10de-4d49-83b8-734c99ce78b8 None admin] RBAC: Adding query filter params (role.id=353a58700c5640988ce2c9012e847cf8, scope.project.id=cd684ec63e1c4d61819302c837dd4349, user.id=f2377f751a584f678c0ddebc4de0ae44) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:40:03.365886 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3fea50-10de-4d49-83b8-734c99ce78b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:03.367239 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3fea50-10de-4d49-83b8-734c99ce78b8 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:03.374194 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 443/881] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:40:03 2022] GET /identity/v3/role_assignments?user.id=f2377f751a584f678c0ddebc4de0ae44&scope.project.id=cd684ec63e1c4d61819302c837dd4349&role.id=353a58700c5640988ce2c9012e847cf8 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:40:05.698606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c62984-dc7b-40ea-af5f-47434d841424 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:05.699242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c62984-dc7b-40ea-af5f-47434d841424 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:05.699242 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c62984-dc7b-40ea-af5f-47434d841424 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:05.700580 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 439/882] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:40:05.707639 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f830b-878d-4719-bf9f-29a282460be8 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:05.708387 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f830b-878d-4719-bf9f-29a282460be8 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:05.708568 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f830b-878d-4719-bf9f-29a282460be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:05.729585 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-039f830b-878d-4719-bf9f-29a282460be8 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:40:05.730777 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-039f830b-878d-4719-bf9f-29a282460be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:40:05.810856 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 444/883] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:40:05 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:40:05.835576 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c62984-dc7b-40ea-af5f-47434d841424 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:05.847723 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:05.948886 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c62984-dc7b-40ea-af5f-47434d841424 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:05.994137 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec5b87-68bb-4393-aaa1-270072939357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:05.995340 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec5b87-68bb-4393-aaa1-270072939357 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:05.995705 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec5b87-68bb-4393-aaa1-270072939357 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:05.996081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec5b87-68bb-4393-aaa1-270072939357 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:06.008413 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec5b87-68bb-4393-aaa1-270072939357 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:40:06.016518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-85ec5b87-68bb-4393-aaa1-270072939357 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:40:06.016518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:40:06.016518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:40:06.016518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:40:06.016518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:40:06.016518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:40:06.016518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:40:06.016518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:40:06.016518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:40:06.016518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:40:06.016518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:40:06.016518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:40:06.016518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:40:06.016518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:40:06.016518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:40:06.016518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:40:06.017655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:40:06.017655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:40:06.017655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:40:06.017655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:40:06.017655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:40:06.017655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:40:06.017655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:40:06.017655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:40:06.017655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:40:06.017655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:40:06.017655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:40:06.017655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:40:06.017655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:40:06.017655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:40:06.017655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:40:06.017655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:40:06.018869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:40:06.018869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:40:06.018869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:40:06.018869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:40:06.018869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:40:06.018869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:40:06.018869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:40:06.018869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:40:06.018869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:40:06.018869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:40:06.018869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:40:06.018869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:40:06.018869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 440/884] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jul 2 20:40:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:40:06.025513 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f830b-878d-4719-bf9f-29a282460be8 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:06.041999 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:06.136133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f830b-878d-4719-bf9f-29a282460be8 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:06.174373 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64695d0-560b-4a51-bbe1-7cd9402febfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:06.175065 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64695d0-560b-4a51-bbe1-7cd9402febfc None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:06.175341 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64695d0-560b-4a51-bbe1-7cd9402febfc None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:06.175583 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64695d0-560b-4a51-bbe1-7cd9402febfc None admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:06.176359 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64695d0-560b-4a51-bbe1-7cd9402febfc None admin] RBAC: Adding query filter params (name=admin) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:40:06.176662 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64695d0-560b-4a51-bbe1-7cd9402febfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:06.178049 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64695d0-560b-4a51-bbe1-7cd9402febfc None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:06.186869 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 445/885] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:40:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:40:06.193627 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec5b87-68bb-4393-aaa1-270072939357 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:06.271616 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:06.309651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec5b87-68bb-4393-aaa1-270072939357 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:06.344563 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63acae52-d44b-4393-98ae-95263547320a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:06.345351 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acae52-d44b-4393-98ae-95263547320a None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:06.345628 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acae52-d44b-4393-98ae-95263547320a None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:06.345896 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acae52-d44b-4393-98ae-95263547320a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:06.358506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63acae52-d44b-4393-98ae-95263547320a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:06.360273 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63acae52-d44b-4393-98ae-95263547320a None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:06.379045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-63acae52-d44b-4393-98ae-95263547320a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:40:06.379045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:40:06.379045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:40:06.379045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:40:06.379045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:40:06.379045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:40:06.379045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:40:06.379045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:40:06.379045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:40:06.379045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:40:06.379045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:40:06.379045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:40:06.379045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:40:06.379045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:40:06.379045 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:40:06.380252 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:40:06.380252 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:40:06.380252 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:40:06.380252 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:40:06.380252 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:40:06.380252 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:40:06.380252 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:40:06.380252 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:40:06.380252 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:40:06.380252 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:40:06.380252 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:40:06.380252 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:40:06.380252 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:40:06.380252 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:40:06.380252 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:40:06.380252 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:40:06.380252 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:40:06.381227 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:40:06.381227 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:40:06.381227 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:40:06.381227 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:40:06.381227 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 441/886] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:40:06.387115 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64695d0-560b-4a51-bbe1-7cd9402febfc None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:06.482380 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:06.510225 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64695d0-560b-4a51-bbe1-7cd9402febfc None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:06.558275 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659d6b4-2f21-4f0f-873e-69cc82ebc10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:06.558947 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659d6b4-2f21-4f0f-873e-69cc82ebc10d None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:06.559238 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659d6b4-2f21-4f0f-873e-69cc82ebc10d None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:06.559506 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9659d6b4-2f21-4f0f-873e-69cc82ebc10d None admin] PATH_INFO: `/v3/domains` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:06.560219 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659d6b4-2f21-4f0f-873e-69cc82ebc10d None admin] RBAC: Adding query filter params (name=Default) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:40:06.560520 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659d6b4-2f21-4f0f-873e-69cc82ebc10d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:06.561991 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9659d6b4-2f21-4f0f-873e-69cc82ebc10d None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:06.578749 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 446/887] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:40:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:40:06.586136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63acae52-d44b-4393-98ae-95263547320a None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:06.689180 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63acae52-d44b-4393-98ae-95263547320a None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:06.709498 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:06.727440 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df1f72-41f9-4a0b-ad13-0d0fde5a809f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:06.728248 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df1f72-41f9-4a0b-ad13-0d0fde5a809f None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:06.728579 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df1f72-41f9-4a0b-ad13-0d0fde5a809f None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:06.728852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df1f72-41f9-4a0b-ad13-0d0fde5a809f None admin] PATH_INFO: `/v3/users/placement` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:06.736648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df1f72-41f9-4a0b-ad13-0d0fde5a809f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:06.738109 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df1f72-41f9-4a0b-ad13-0d0fde5a809f None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:06.752381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-29df1f72-41f9-4a0b-ad13-0d0fde5a809f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 02 20:40:06.752381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:40:06.752381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:40:06.752381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:40:06.752381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:40:06.752381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:40:06.752381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:40:06.752381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:40:06.752381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:40:06.752381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:40:06.752381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:40:06.752381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:40:06.752381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:40:06.752381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:40:06.752381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:40:06.752381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:40:06.753399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:40:06.753399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:40:06.753399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:40:06.753399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:40:06.753399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:40:06.753399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:40:06.753399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:40:06.753399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:40:06.753399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:40:06.753399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:40:06.753399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:40:06.753399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:40:06.753399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:40:06.753399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:40:06.753399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:40:06.753399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:40:06.753399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:40:06.753399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:40:06.754730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:40:06.754730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:40:06.754730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:40:06.754730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:40:06.754730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:40:06.754730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:40:06.754730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:40:06.754730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:40:06.754730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 02 20:40:06.754730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:40:06.754730 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 442/888] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:40:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:40:06.760093 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659d6b4-2f21-4f0f-873e-69cc82ebc10d None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:06.872648 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9659d6b4-2f21-4f0f-873e-69cc82ebc10d None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:06.921189 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4757cc-32b4-47dc-a6c9-513b5e007941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:06.921854 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4757cc-32b4-47dc-a6c9-513b5e007941 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:06.922129 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4757cc-32b4-47dc-a6c9-513b5e007941 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:06.922397 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4757cc-32b4-47dc-a6c9-513b5e007941 None admin] PATH_INFO: `/v3/users` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:06.923297 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4757cc-32b4-47dc-a6c9-513b5e007941 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:40:06.923608 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4757cc-32b4-47dc-a6c9-513b5e007941 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:06.925031 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4757cc-32b4-47dc-a6c9-513b5e007941 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:06.927612 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:06.943780 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 447/889] 10.222.0.57 () {56 vars in 1143 bytes} [Sat Jul 2 20:40:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:40:06.950244 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df1f72-41f9-4a0b-ad13-0d0fde5a809f None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:07.055489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df1f72-41f9-4a0b-ad13-0d0fde5a809f None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:07.091318 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc7051-0976-4c1f-8cba-70c300351756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:07.092107 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc7051-0976-4c1f-8cba-70c300351756 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:07.092444 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc7051-0976-4c1f-8cba-70c300351756 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:07.092698 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bc7051-0976-4c1f-8cba-70c300351756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:07.103301 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc7051-0976-4c1f-8cba-70c300351756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:07.104743 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bc7051-0976-4c1f-8cba-70c300351756 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:07.121485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-c6bc7051-0976-4c1f-8cba-70c300351756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:40:07.121485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:40:07.121485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:40:07.121485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:40:07.121485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:40:07.121485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:40:07.121485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:40:07.121485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:40:07.121485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:40:07.121485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:40:07.121485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:40:07.121485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:40:07.121485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:40:07.121485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:40:07.121485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:40:07.122485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:40:07.122485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:40:07.122485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:40:07.122485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:40:07.122485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:40:07.122485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:40:07.122485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:40:07.122485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:40:07.122485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:40:07.122485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:40:07.122485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:40:07.122485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:40:07.122485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:40:07.122485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:40:07.122485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:40:07.122485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:40:07.122485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:40:07.123491 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:40:07.123491 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:40:07.123491 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:40:07.123491 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:40:07.123491 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 443/890] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:40:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:40:07.131164 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4757cc-32b4-47dc-a6c9-513b5e007941 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:07.247513 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4757cc-32b4-47dc-a6c9-513b5e007941 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:07.300846 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d179f-5c43-4348-b8dd-f1406784f4aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:07.301898 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d179f-5c43-4348-b8dd-f1406784f4aa None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:07.302344 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d179f-5c43-4348-b8dd-f1406784f4aa None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:07.302773 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d179f-5c43-4348-b8dd-f1406784f4aa None admin] PATH_INFO: `/v3/domains` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:07.303990 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d179f-5c43-4348-b8dd-f1406784f4aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:40:07.304476 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d179f-5c43-4348-b8dd-f1406784f4aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:07.306643 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472d179f-5c43-4348-b8dd-f1406784f4aa None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:07.320865 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 448/891] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:40:07.327519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc7051-0976-4c1f-8cba-70c300351756 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:07.367704 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:07.445194 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bc7051-0976-4c1f-8cba-70c300351756 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:07.482281 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd930b-6120-4612-9310-701657d7aa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:07.483079 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd930b-6120-4612-9310-701657d7aa96 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:07.483382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd930b-6120-4612-9310-701657d7aa96 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:07.483665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd930b-6120-4612-9310-701657d7aa96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:07.491102 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd930b-6120-4612-9310-701657d7aa96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:07.492572 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd930b-6120-4612-9310-701657d7aa96 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:07.507160 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-3cbd930b-6120-4612-9310-701657d7aa96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:40:07.507160 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:40:07.507160 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:40:07.507160 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:40:07.507160 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:40:07.507160 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:40:07.507160 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:40:07.507160 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:40:07.507160 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:40:07.507160 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:40:07.507160 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:40:07.507160 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:40:07.507160 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:40:07.507160 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:40:07.507160 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:40:07.508123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:40:07.508123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:40:07.508123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:40:07.508123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:40:07.508123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:40:07.508123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:40:07.508123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:40:07.508123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:40:07.508123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:40:07.508123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:40:07.508123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:40:07.508123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:40:07.508123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:40:07.508123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:40:07.508123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:40:07.508123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:40:07.508123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:40:07.509312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:40:07.509312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:40:07.509312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:40:07.509312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:40:07.509312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:40:07.509312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:40:07.509312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:40:07.509312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:40:07.509312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 444/892] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:40:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:40:07.515043 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d179f-5c43-4348-b8dd-f1406784f4aa None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:07.578415 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:07.628271 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d179f-5c43-4348-b8dd-f1406784f4aa None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:07.664423 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7572f86-d2c7-432f-bf26-2241722ecd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:07.665068 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7572f86-d2c7-432f-bf26-2241722ecd60 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:07.665341 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7572f86-d2c7-432f-bf26-2241722ecd60 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:07.665611 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7572f86-d2c7-432f-bf26-2241722ecd60 None admin] PATH_INFO: `/v3/projects` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:07.666387 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7572f86-d2c7-432f-bf26-2241722ecd60 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:40:07.666684 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7572f86-d2c7-432f-bf26-2241722ecd60 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:07.668145 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7572f86-d2c7-432f-bf26-2241722ecd60 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:07.680153 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 449/893] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jul 2 20:40:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:40:07.686732 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd930b-6120-4612-9310-701657d7aa96 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:07.791507 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:07.801286 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd930b-6120-4612-9310-701657d7aa96 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:07.837488 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2152a12c-f1a0-4227-a99a-30472db98369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:07.838366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152a12c-f1a0-4227-a99a-30472db98369 None admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:07.838644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152a12c-f1a0-4227-a99a-30472db98369 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:07.838948 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2152a12c-f1a0-4227-a99a-30472db98369 None admin] PATH_INFO: `/v3/projects/cd684ec63e1c4d61819302c837dd4349/users/f2377f751a584f678c0ddebc4de0ae44/roles/353a58700c5640988ce2c9012e847cf8` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:07.841188 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152a12c-f1a0-4227-a99a-30472db98369 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd684ec63e1c4d61819302c837dd4349, user_id=f2377f751a584f678c0ddebc4de0ae44, role_id=353a58700c5640988ce2c9012e847cf8)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:07.842695 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2152a12c-f1a0-4227-a99a-30472db98369 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:07.859505 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 445/894] 10.222.0.57 () {58 vars in 1439 bytes} [Sat Jul 2 20:40:07 2022] PUT /identity/v3/projects/cd684ec63e1c4d61819302c837dd4349/users/f2377f751a584f678c0ddebc4de0ae44/roles/353a58700c5640988ce2c9012e847cf8 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:40:10.100707 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395048b2-418d-42ff-80c8-64d346397266 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:10.101569 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395048b2-418d-42ff-80c8-64d346397266 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:10.101569 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395048b2-418d-42ff-80c8-64d346397266 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:10.103907 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 450/895] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:40:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:40:10.112451 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b911a-9596-45d9-ac50-690cd961b2e3 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:10.112882 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b911a-9596-45d9-ac50-690cd961b2e3 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:10.113024 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b911a-9596-45d9-ac50-690cd961b2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:10.140900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-7b8b911a-9596-45d9-ac50-690cd961b2e3 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:40:10.142095 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-7b8b911a-9596-45d9-ac50-690cd961b2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:40:10.216596 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 446/896] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:40:10 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:40:10.253451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395048b2-418d-42ff-80c8-64d346397266 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:10.365431 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395048b2-418d-42ff-80c8-64d346397266 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:10.382113 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:10.406366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1123c26-989b-4493-9e86-7cc006b29957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:10.407335 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1123c26-989b-4493-9e86-7cc006b29957 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:10.407606 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1123c26-989b-4493-9e86-7cc006b29957 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:10.407927 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1123c26-989b-4493-9e86-7cc006b29957 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:10.419818 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1123c26-989b-4493-9e86-7cc006b29957 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 02 20:40:10.429019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-b1123c26-989b-4493-9e86-7cc006b29957 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:40:10.429019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:40:10.429019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:40:10.429019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:40:10.429019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:40:10.429019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:40:10.429019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:40:10.429019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:40:10.429019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:40:10.429019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:40:10.429019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:40:10.429019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:40:10.429019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 02 20:40:10.429019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 02 20:40:10.429019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 02 20:40:10.429019 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 02 20:40:10.430018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 02 20:40:10.430018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 02 20:40:10.430018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 02 20:40:10.430018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 02 20:40:10.430018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:40:10.430018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:40:10.430018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:40:10.430018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:40:10.430018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:40:10.430018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:40:10.430018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:40:10.430018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:40:10.430018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:40:10.430018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:40:10.430018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:40:10.430018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:40:10.430862 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:40:10.430862 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:40:10.430862 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:40:10.430862 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:40:10.430862 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 02 20:40:10.430862 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 02 20:40:10.430862 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 02 20:40:10.430862 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 02 20:40:10.430862 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 02 20:40:10.430862 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 02 20:40:10.430862 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 02 20:40:10.430862 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:40:10.430862 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 451/897] 10.222.0.57 () {56 vars in 1096 bytes} [Sat Jul 2 20:40:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:40:10.437051 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b911a-9596-45d9-ac50-690cd961b2e3 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:10.518890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:10.542413 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8b911a-9596-45d9-ac50-690cd961b2e3 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:10.578753 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf65d66-0aaf-44c8-b25d-7eb4029a9eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:10.579452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf65d66-0aaf-44c8-b25d-7eb4029a9eae None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:10.579738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf65d66-0aaf-44c8-b25d-7eb4029a9eae None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:10.580015 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf65d66-0aaf-44c8-b25d-7eb4029a9eae None admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:10.580762 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf65d66-0aaf-44c8-b25d-7eb4029a9eae None admin] RBAC: Adding query filter params (name=admin) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:40:10.581074 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf65d66-0aaf-44c8-b25d-7eb4029a9eae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:10.582464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf65d66-0aaf-44c8-b25d-7eb4029a9eae None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:10.591212 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 447/898] 10.222.0.57 () {56 vars in 1099 bytes} [Sat Jul 2 20:40:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:40:10.597896 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1123c26-989b-4493-9e86-7cc006b29957 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:10.704710 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1123c26-989b-4493-9e86-7cc006b29957 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:10.741592 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f239aa-7e91-4e4f-b16f-4f0708d95154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:10.742388 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f239aa-7e91-4e4f-b16f-4f0708d95154 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:10.742663 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f239aa-7e91-4e4f-b16f-4f0708d95154 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:10.742949 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f239aa-7e91-4e4f-b16f-4f0708d95154 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:10.755509 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f239aa-7e91-4e4f-b16f-4f0708d95154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:10.756980 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f239aa-7e91-4e4f-b16f-4f0708d95154 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:10.774692 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-33f239aa-7e91-4e4f-b16f-4f0708d95154 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:40:10.774692 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:40:10.774692 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:40:10.774692 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:40:10.774692 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:40:10.774692 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:40:10.774692 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:40:10.774692 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:40:10.774692 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:40:10.774692 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:40:10.774692 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:40:10.774692 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:40:10.774692 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:40:10.774692 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:40:10.774692 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:40:10.775717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:40:10.775717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:40:10.775717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:40:10.775717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:40:10.775717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:40:10.775717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:40:10.775717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:40:10.775717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:40:10.775717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:40:10.775717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:40:10.775717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:40:10.775717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:40:10.775717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:40:10.775717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:40:10.775717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:40:10.775717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:40:10.775717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:40:10.776717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:40:10.776717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:40:10.776717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:40:10.776717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:40:10.776717 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 452/899] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:40:10.781927 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf65d66-0aaf-44c8-b25d-7eb4029a9eae None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:10.885285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf65d66-0aaf-44c8-b25d-7eb4029a9eae None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:10.920712 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4d80f-0cda-48ee-baec-24427df6bfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:10.921468 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4d80f-0cda-48ee-baec-24427df6bfcd None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:10.921751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4d80f-0cda-48ee-baec-24427df6bfcd None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:10.922027 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a4d80f-0cda-48ee-baec-24427df6bfcd None admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:10.922747 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4d80f-0cda-48ee-baec-24427df6bfcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:40:10.923081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4d80f-0cda-48ee-baec-24427df6bfcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:10.924456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a4d80f-0cda-48ee-baec-24427df6bfcd None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:10.936448 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 448/900] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:40:10.942226 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f239aa-7e91-4e4f-b16f-4f0708d95154 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:10.972341 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:11.064176 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f239aa-7e91-4e4f-b16f-4f0708d95154 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:11.098868 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b9bf0-fdc3-4639-a9e1-cd256a27d8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:11.099704 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b9bf0-fdc3-4639-a9e1-cd256a27d8fe None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:11.099974 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b9bf0-fdc3-4639-a9e1-cd256a27d8fe None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:11.100241 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4b9bf0-fdc3-4639-a9e1-cd256a27d8fe None admin] PATH_INFO: `/v3/users/placement` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:11.111551 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b9bf0-fdc3-4639-a9e1-cd256a27d8fe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:11.113558 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4b9bf0-fdc3-4639-a9e1-cd256a27d8fe None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:11.132272 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-4f4b9bf0-fdc3-4639-a9e1-cd256a27d8fe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 02 20:40:11.132272 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:40:11.132272 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:40:11.132272 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:40:11.132272 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:40:11.132272 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:40:11.132272 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:40:11.132272 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:40:11.132272 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:40:11.132272 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:40:11.132272 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:40:11.132272 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:40:11.132272 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 02 20:40:11.132272 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 02 20:40:11.132272 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 02 20:40:11.132272 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 02 20:40:11.133445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:40:11.133445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:40:11.133445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 02 20:40:11.133445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:40:11.133445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 02 20:40:11.133445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 02 20:40:11.133445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:40:11.133445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:40:11.133445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:40:11.133445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:40:11.133445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:40:11.133445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:40:11.133445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:40:11.133445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:40:11.133445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:40:11.133445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:40:11.133445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:40:11.133445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:40:11.134536 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:40:11.134536 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:40:11.134536 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 02 20:40:11.134536 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 02 20:40:11.134536 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 02 20:40:11.134536 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 02 20:40:11.134536 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 02 20:40:11.134536 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 02 20:40:11.134536 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 02 20:40:11.134536 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:40:11.134536 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 453/901] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:40:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:40:11.141539 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4d80f-0cda-48ee-baec-24427df6bfcd None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:11.145918 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:11.246618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a4d80f-0cda-48ee-baec-24427df6bfcd None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:11.286290 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8af89-8b4a-4659-980f-eb16ca2325c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:11.286971 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8af89-8b4a-4659-980f-eb16ca2325c3 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:11.287279 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8af89-8b4a-4659-980f-eb16ca2325c3 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:11.287557 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8af89-8b4a-4659-980f-eb16ca2325c3 None admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:11.288397 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8af89-8b4a-4659-980f-eb16ca2325c3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:40:11.288712 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8af89-8b4a-4659-980f-eb16ca2325c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:11.290158 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8af89-8b4a-4659-980f-eb16ca2325c3 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:11.307586 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 449/902] 10.222.0.57 () {56 vars in 1143 bytes} [Sat Jul 2 20:40:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:40:11.313684 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b9bf0-fdc3-4639-a9e1-cd256a27d8fe None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:11.407603 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:11.422645 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4b9bf0-fdc3-4639-a9e1-cd256a27d8fe None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:11.458130 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4b450-30a1-4862-a02d-dbfd0254515f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:11.458769 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4b450-30a1-4862-a02d-dbfd0254515f None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:11.459080 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4b450-30a1-4862-a02d-dbfd0254515f None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:11.459350 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4b450-30a1-4862-a02d-dbfd0254515f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:11.533056 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4b450-30a1-4862-a02d-dbfd0254515f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:11.534448 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4b450-30a1-4862-a02d-dbfd0254515f None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:11.619550 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:11.636544 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 454/903] 10.222.0.57 () {58 vars in 1282 bytes} [Sat Jul 2 20:40:11 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 02 20:40:11.643111 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8af89-8b4a-4659-980f-eb16ca2325c3 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:11.709791 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:11.749642 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8af89-8b4a-4659-980f-eb16ca2325c3 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:11.785800 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04cf9a-37d7-4ba3-87a4-562739b1d2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:11.786524 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04cf9a-37d7-4ba3-87a4-562739b1d2a3 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:11.786803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04cf9a-37d7-4ba3-87a4-562739b1d2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:11.787108 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd04cf9a-37d7-4ba3-87a4-562739b1d2a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:11.797779 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04cf9a-37d7-4ba3-87a4-562739b1d2a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:11.799286 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd04cf9a-37d7-4ba3-87a4-562739b1d2a3 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:11.817464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-fd04cf9a-37d7-4ba3-87a4-562739b1d2a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:40:11.817464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:40:11.817464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:40:11.817464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:40:11.817464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:40:11.817464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:40:11.817464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:40:11.817464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:40:11.817464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:40:11.817464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:40:11.817464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:40:11.817464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:40:11.817464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 02 20:40:11.817464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 02 20:40:11.817464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 02 20:40:11.818396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 02 20:40:11.818396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:40:11.818396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:40:11.818396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:40:11.818396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:40:11.818396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:40:11.818396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:40:11.818396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:40:11.818396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:40:11.818396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:40:11.818396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:40:11.818396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:40:11.818396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:40:11.818396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:40:11.818396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:40:11.818396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:40:11.818396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:40:11.819343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 02 20:40:11.819343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 02 20:40:11.819343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 02 20:40:11.819343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:40:11.819343 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 450/904] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:40:11.824928 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4b450-30a1-4862-a02d-dbfd0254515f None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:11.931534 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4b450-30a1-4862-a02d-dbfd0254515f None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:11.977627 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f65bcc-a5cf-47e9-8df4-4316cfbd041e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:11.978288 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f65bcc-a5cf-47e9-8df4-4316cfbd041e None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:11.978560 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f65bcc-a5cf-47e9-8df4-4316cfbd041e None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:11.978825 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f65bcc-a5cf-47e9-8df4-4316cfbd041e None admin] PATH_INFO: `/v3/domains` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:11.979592 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f65bcc-a5cf-47e9-8df4-4316cfbd041e None admin] RBAC: Adding query filter params (name=Default) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:40:11.979896 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f65bcc-a5cf-47e9-8df4-4316cfbd041e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:11.981255 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f65bcc-a5cf-47e9-8df4-4316cfbd041e None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:11.992784 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 455/905] 10.222.0.57 () {56 vars in 1109 bytes} [Sat Jul 2 20:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:40:12.000723 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04cf9a-37d7-4ba3-87a4-562739b1d2a3 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:12.108945 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd04cf9a-37d7-4ba3-87a4-562739b1d2a3 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:12.123372 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:12.146214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f36e1-aaf1-4950-8d18-baa8ecd97251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:12.147035 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f36e1-aaf1-4950-8d18-baa8ecd97251 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:12.147306 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f36e1-aaf1-4950-8d18-baa8ecd97251 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:12.147564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f36e1-aaf1-4950-8d18-baa8ecd97251 None admin] PATH_INFO: `/v3/projects/service` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:12.157399 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f36e1-aaf1-4950-8d18-baa8ecd97251 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:12.159680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f36e1-aaf1-4950-8d18-baa8ecd97251 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:12.179576 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application [None req-df9f36e1-aaf1-4950-8d18-baa8ecd97251 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:40:12.179576 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:40:12.179576 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:40:12.179576 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:40:12.179576 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:40:12.179576 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:40:12.179576 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:40:12.179576 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:40:12.179576 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:40:12.179576 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:40:12.179576 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:40:12.179576 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:40:12.179576 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 02 20:40:12.179576 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 02 20:40:12.179576 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 02 20:40:12.180665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 02 20:40:12.180665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:40:12.180665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:40:12.180665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:40:12.180665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:40:12.180665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:40:12.180665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:40:12.180665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:40:12.180665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application with Lock( Jul 02 20:40:12.180665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:40:12.180665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:40:12.180665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:40:12.180665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:40:12.180665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:40:12.180665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:40:12.180665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:40:12.180665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:40:12.181590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 02 20:40:12.181590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 02 20:40:12.181590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 02 20:40:12.181590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 02 20:40:12.181590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 02 20:40:12.181590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 02 20:40:12.181590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 02 20:40:12.181590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: ERROR keystone.server.flask.application Jul 02 20:40:12.181590 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 451/906] 10.222.0.57 () {56 vars in 1111 bytes} [Sat Jul 2 20:40:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:40:12.187018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f65bcc-a5cf-47e9-8df4-4316cfbd041e None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:12.236771 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:12.294133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f65bcc-a5cf-47e9-8df4-4316cfbd041e None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:12.328316 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e370caf1-b505-488d-9427-a6a673640b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:12.328966 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370caf1-b505-488d-9427-a6a673640b4f None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:12.329244 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370caf1-b505-488d-9427-a6a673640b4f None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:12.329492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e370caf1-b505-488d-9427-a6a673640b4f None admin] PATH_INFO: `/v3/projects` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:12.330268 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370caf1-b505-488d-9427-a6a673640b4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:40:12.330569 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370caf1-b505-488d-9427-a6a673640b4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:12.332027 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e370caf1-b505-488d-9427-a6a673640b4f None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:12.343981 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 456/907] 10.222.0.57 () {56 vars in 1148 bytes} [Sat Jul 2 20:40:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:40:12.353228 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f36e1-aaf1-4950-8d18-baa8ecd97251 None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:12.475359 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f36e1-aaf1-4950-8d18-baa8ecd97251 None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:12.510437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03569f77-3885-4943-8153-85d4a604324e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:12.511119 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03569f77-3885-4943-8153-85d4a604324e None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:12.511406 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03569f77-3885-4943-8153-85d4a604324e None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:12.511674 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03569f77-3885-4943-8153-85d4a604324e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:12.512528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03569f77-3885-4943-8153-85d4a604324e None admin] RBAC: Adding query filter params (role.id=353a58700c5640988ce2c9012e847cf8, scope.project.id=cd684ec63e1c4d61819302c837dd4349, user.id=f2377f751a584f678c0ddebc4de0ae44) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:40:12.512835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03569f77-3885-4943-8153-85d4a604324e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:12.514258 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03569f77-3885-4943-8153-85d4a604324e None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:12.520307 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 452/908] 10.222.0.57 () {56 vars in 1374 bytes} [Sat Jul 2 20:40:12 2022] GET /identity/v3/role_assignments?user.id=f2377f751a584f678c0ddebc4de0ae44&scope.project.id=cd684ec63e1c4d61819302c837dd4349&role.id=353a58700c5640988ce2c9012e847cf8 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:40:14.784776 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7cbd1-87c5-4ba3-9d17-c24976cff748 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:14.785616 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7cbd1-87c5-4ba3-9d17-c24976cff748 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:14.785616 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7cbd1-87c5-4ba3-9d17-c24976cff748 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:14.787897 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 457/909] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:40:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:40:14.793483 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446eb37-ee2e-47e4-9be3-81088b494e22 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:14.793916 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446eb37-ee2e-47e4-9be3-81088b494e22 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:14.794008 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446eb37-ee2e-47e4-9be3-81088b494e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:14.815202 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-7446eb37-ee2e-47e4-9be3-81088b494e22 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:40:14.816404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-7446eb37-ee2e-47e4-9be3-81088b494e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:40:14.846881 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:14.887974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 453/910] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:40:14 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:40:14.912867 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7cbd1-87c5-4ba3-9d17-c24976cff748 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:15.030423 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7cbd1-87c5-4ba3-9d17-c24976cff748 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:15.037595 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:15.068326 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe122b-5c19-4326-bab0-a924c1a8762d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:15.069118 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe122b-5c19-4326-bab0-a924c1a8762d None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:15.069393 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe122b-5c19-4326-bab0-a924c1a8762d None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:15.069661 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe122b-5c19-4326-bab0-a924c1a8762d None admin] PATH_INFO: `/v3/services/placement` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:15.070295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe122b-5c19-4326-bab0-a924c1a8762d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:15.071696 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe122b-5c19-4326-bab0-a924c1a8762d None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:15.084293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-3bbe122b-5c19-4326-bab0-a924c1a8762d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 20:40:15.084293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:40:15.084293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:40:15.084293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:40:15.084293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:40:15.084293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:40:15.084293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:40:15.084293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:40:15.084293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 20:40:15.084293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:40:15.084293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:40:15.084293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:40:15.084293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:40:15.084293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:40:15.084293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:40:15.084293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:40:15.084293 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:40:15.085435 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:40:15.085435 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:40:15.085435 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:40:15.085435 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:40:15.085435 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:40:15.085435 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:40:15.085435 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:40:15.085435 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:40:15.085435 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:40:15.085435 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:40:15.085435 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:40:15.085435 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:40:15.085435 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:40:15.085435 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:40:15.085435 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:40:15.085435 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:40:15.086803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:40:15.086803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:40:15.086803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:40:15.086803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:40:15.086803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:40:15.086803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:40:15.086803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:40:15.086803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:40:15.086803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:40:15.086803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:40:15.086803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:40:15.086803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:40:15.086803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 20:40:15.086803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:40:15.086803 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 458/911] 10.222.0.57 () {56 vars in 1117 bytes} [Sat Jul 2 20:40:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:40:15.095327 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446eb37-ee2e-47e4-9be3-81088b494e22 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:15.209370 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446eb37-ee2e-47e4-9be3-81088b494e22 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:15.246129 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e8881-bfd5-4750-88d9-0f47493cdebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:15.246785 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e8881-bfd5-4750-88d9-0f47493cdebf None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:15.247101 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e8881-bfd5-4750-88d9-0f47493cdebf None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:15.247378 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e8881-bfd5-4750-88d9-0f47493cdebf None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:15.248089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e8881-bfd5-4750-88d9-0f47493cdebf None admin] RBAC: Adding query filter params (name=placement) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:40:15.248396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e8881-bfd5-4750-88d9-0f47493cdebf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:15.250257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788e8881-bfd5-4750-88d9-0f47493cdebf None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:15.255404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 454/912] 10.222.0.57 () {56 vars in 1116 bytes} [Sat Jul 2 20:40:15 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:40:15.261492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe122b-5c19-4326-bab0-a924c1a8762d None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:15.370512 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe122b-5c19-4326-bab0-a924c1a8762d None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:15.412274 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62cd38b-4bc7-400f-b293-318780b32ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:15.413135 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cd38b-4bc7-400f-b293-318780b32ac4 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:15.413517 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cd38b-4bc7-400f-b293-318780b32ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:15.413804 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62cd38b-4bc7-400f-b293-318780b32ac4 None admin] PATH_INFO: `/v3/services` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:15.414709 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cd38b-4bc7-400f-b293-318780b32ac4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:40:15.415177 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cd38b-4bc7-400f-b293-318780b32ac4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:15.416821 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62cd38b-4bc7-400f-b293-318780b32ac4 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:15.423094 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 459/913] 10.222.0.57 () {56 vars in 1116 bytes} [Sat Jul 2 20:40:15 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:40:17.677852 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f395e-73f3-46fc-af53-0941d6ed2045 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:17.678772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f395e-73f3-46fc-af53-0941d6ed2045 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:17.678772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f395e-73f3-46fc-af53-0941d6ed2045 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:17.680978 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 455/914] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:40:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:40:17.686567 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac6fd9-9de8-450e-b044-1c7e1f3b49da None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:17.687021 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac6fd9-9de8-450e-b044-1c7e1f3b49da None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:17.687113 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac6fd9-9de8-450e-b044-1c7e1f3b49da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:17.712726 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-f3ac6fd9-9de8-450e-b044-1c7e1f3b49da None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:40:17.714554 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-f3ac6fd9-9de8-450e-b044-1c7e1f3b49da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:40:17.744423 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:17.787503 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 460/915] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:40:17 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:40:17.820676 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f395e-73f3-46fc-af53-0941d6ed2045 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:17.857748 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:17.939229 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f395e-73f3-46fc-af53-0941d6ed2045 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:17.980180 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc76b0b-9ff3-406c-acb0-82ba4229ac80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:17.981056 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc76b0b-9ff3-406c-acb0-82ba4229ac80 None admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:17.981210 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc76b0b-9ff3-406c-acb0-82ba4229ac80 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:17.981347 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc76b0b-9ff3-406c-acb0-82ba4229ac80 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:17.982094 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc76b0b-9ff3-406c-acb0-82ba4229ac80 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:17.983658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc76b0b-9ff3-406c-acb0-82ba4229ac80 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:17.998847 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 456/916] 10.222.0.57 () {60 vars in 1141 bytes} [Sat Jul 2 20:40:17 2022] POST /identity/v3/services => generated 246 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:40:20.299557 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583953f-1582-452e-af71-00330b8f7336 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:20.300406 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583953f-1582-452e-af71-00330b8f7336 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:20.300406 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2583953f-1582-452e-af71-00330b8f7336 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:20.302583 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 461/917] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:40:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:40:20.311818 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf464b-8267-49c1-8435-0122c11fffee None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:20.312275 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf464b-8267-49c1-8435-0122c11fffee None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:20.312409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bf464b-8267-49c1-8435-0122c11fffee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:20.337085 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-67bf464b-8267-49c1-8435-0122c11fffee None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:40:20.338323 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-67bf464b-8267-49c1-8435-0122c11fffee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:40:20.423122 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 457/918] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:40:20 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:40:20.447646 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583953f-1582-452e-af71-00330b8f7336 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:20.555984 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2583953f-1582-452e-af71-00330b8f7336 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:20.597509 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c0bee-d210-4084-b8d6-37b746c149d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:20.598292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c0bee-d210-4084-b8d6-37b746c149d9 None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:20.598560 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c0bee-d210-4084-b8d6-37b746c149d9 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:20.598824 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c0bee-d210-4084-b8d6-37b746c149d9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:20.599499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c0bee-d210-4084-b8d6-37b746c149d9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:20.600855 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c0bee-d210-4084-b8d6-37b746c149d9 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:20.613100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-df6c0bee-d210-4084-b8d6-37b746c149d9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 20:40:20.613100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:40:20.613100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:40:20.613100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:40:20.613100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:40:20.613100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:40:20.613100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:40:20.613100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:40:20.613100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 20:40:20.613100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:40:20.613100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:40:20.613100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:40:20.613100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:40:20.613100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:40:20.613100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:40:20.613100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:40:20.613100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:40:20.614178 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:40:20.614178 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:40:20.614178 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:40:20.614178 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:40:20.614178 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:40:20.614178 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:40:20.614178 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:40:20.614178 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:40:20.614178 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:40:20.614178 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:40:20.614178 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:40:20.614178 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:40:20.614178 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:40:20.614178 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:40:20.614178 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:40:20.614178 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:40:20.615301 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:40:20.615301 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:40:20.615301 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:40:20.615301 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:40:20.615301 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:40:20.615301 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:40:20.615301 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:40:20.615301 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:40:20.615301 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:40:20.615301 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:40:20.615301 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:40:20.615301 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:40:20.615301 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 20:40:20.615301 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:40:20.615301 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 462/919] 10.222.0.57 () {56 vars in 1117 bytes} [Sat Jul 2 20:40:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:40:20.620594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf464b-8267-49c1-8435-0122c11fffee None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:20.641976 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:20.729593 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bf464b-8267-49c1-8435-0122c11fffee None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:20.765417 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12eb07-e9d0-4f9a-8ebf-837203d09e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:20.766079 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12eb07-e9d0-4f9a-8ebf-837203d09e3b None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:20.766361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12eb07-e9d0-4f9a-8ebf-837203d09e3b None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:20.766630 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12eb07-e9d0-4f9a-8ebf-837203d09e3b None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:20.767375 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12eb07-e9d0-4f9a-8ebf-837203d09e3b None admin] RBAC: Adding query filter params (name=placement) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:40:20.767688 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12eb07-e9d0-4f9a-8ebf-837203d09e3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:20.769061 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12eb07-e9d0-4f9a-8ebf-837203d09e3b None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:20.774443 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 458/920] 10.222.0.57 () {56 vars in 1116 bytes} [Sat Jul 2 20:40:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:40:20.780918 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c0bee-d210-4084-b8d6-37b746c149d9 None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:20.810675 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:20.885708 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c0bee-d210-4084-b8d6-37b746c149d9 None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:20.922213 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f4e86-3e4f-4320-8386-6563b4e53d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:20.922851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f4e86-3e4f-4320-8386-6563b4e53d7e None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:20.923155 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f4e86-3e4f-4320-8386-6563b4e53d7e None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:20.923424 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f4e86-3e4f-4320-8386-6563b4e53d7e None admin] PATH_INFO: `/v3/endpoints` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:20.924189 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f4e86-3e4f-4320-8386-6563b4e53d7e None admin] RBAC: Adding query filter params (interface=public, service_id=fbef8a7a968e4bafb72c2aff2b9e98e0, region_id=RegionOne) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:40:20.924492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f4e86-3e4f-4320-8386-6563b4e53d7e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:20.925874 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f4e86-3e4f-4320-8386-6563b4e53d7e None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:20.930927 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 463/921] 10.222.0.57 () {56 vars in 1251 bytes} [Sat Jul 2 20:40:20 2022] GET /identity/v3/endpoints?service_id=fbef8a7a968e4bafb72c2aff2b9e98e0&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:40:20.937626 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12eb07-e9d0-4f9a-8ebf-837203d09e3b None admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:21.042310 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:21.062150 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12eb07-e9d0-4f9a-8ebf-837203d09e3b None admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:21.097492 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703520ae-5946-4c5a-9752-dd76be8b4995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:21.098123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703520ae-5946-4c5a-9752-dd76be8b4995 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:21.098427 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703520ae-5946-4c5a-9752-dd76be8b4995 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:21.098690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703520ae-5946-4c5a-9752-dd76be8b4995 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:21.099398 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703520ae-5946-4c5a-9752-dd76be8b4995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:21.100792 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703520ae-5946-4c5a-9752-dd76be8b4995 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:21.107429 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 459/922] 10.222.0.57 () {56 vars in 1087 bytes} [Sat Jul 2 20:40:20 2022] GET /identity/v3/services => generated 1962 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 20:40:23.380847 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eb8a9-f10d-4f0b-be34-21045c99f7fb None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:23.381721 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eb8a9-f10d-4f0b-be34-21045c99f7fb None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:23.381827 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eb8a9-f10d-4f0b-be34-21045c99f7fb None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:23.384060 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 464/923] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:40:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:40:23.390651 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f698e-660a-4e38-89e3-03efcb202dc4 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:23.391421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f698e-660a-4e38-89e3-03efcb202dc4 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:23.391562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f698e-660a-4e38-89e3-03efcb202dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:23.420470 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-769f698e-660a-4e38-89e3-03efcb202dc4 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:40:23.421647 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-769f698e-660a-4e38-89e3-03efcb202dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:40:23.493339 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 460/924] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:40:23 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 02 20:40:23.517765 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eb8a9-f10d-4f0b-be34-21045c99f7fb None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:23.626774 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:23.642542 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eb8a9-f10d-4f0b-be34-21045c99f7fb None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:23.683398 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b46425-f759-4b60-bde3-dfbe79e67e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:23.684549 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b46425-f759-4b60-bde3-dfbe79e67e4b None admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:23.684933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b46425-f759-4b60-bde3-dfbe79e67e4b None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:23.685294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b46425-f759-4b60-bde3-dfbe79e67e4b None admin] PATH_INFO: `/v3/services/placement` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:23.686223 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b46425-f759-4b60-bde3-dfbe79e67e4b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:23.687636 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b46425-f759-4b60-bde3-dfbe79e67e4b None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:23.700135 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application [None req-77b46425-f759-4b60-bde3-dfbe79e67e4b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 20:40:23.700135 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:40:23.700135 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 02 20:40:23.700135 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 02 20:40:23.700135 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 02 20:40:23.700135 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 02 20:40:23.700135 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 02 20:40:23.700135 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:40:23.700135 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 20:40:23.700135 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:40:23.700135 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 02 20:40:23.700135 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:40:23.700135 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 02 20:40:23.700135 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 02 20:40:23.700135 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 02 20:40:23.700135 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 02 20:40:23.700135 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 02 20:40:23.701249 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 02 20:40:23.701249 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 02 20:40:23.701249 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 02 20:40:23.701249 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 02 20:40:23.701249 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 02 20:40:23.701249 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 02 20:40:23.701249 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 02 20:40:23.701249 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 02 20:40:23.701249 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 02 20:40:23.701249 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 02 20:40:23.701249 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 02 20:40:23.701249 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 02 20:40:23.701249 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 02 20:40:23.701249 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 02 20:40:23.701249 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 02 20:40:23.701249 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.get_or_create( Jul 02 20:40:23.702721 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 02 20:40:23.702721 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application with Lock( Jul 02 20:40:23.702721 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 02 20:40:23.702721 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self._enter() Jul 02 20:40:23.702721 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 02 20:40:23.702721 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 02 20:40:23.702721 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 02 20:40:23.702721 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application return self.creator() Jul 02 20:40:23.702721 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 02 20:40:23.702721 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application created_value = creator( Jul 02 20:40:23.702721 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 02 20:40:23.702721 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 02 20:40:23.702721 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 02 20:40:23.702721 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: ERROR keystone.server.flask.application Jul 02 20:40:23.702721 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 465/925] 10.222.0.57 () {56 vars in 1117 bytes} [Sat Jul 2 20:40:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 02 20:40:23.707920 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f698e-660a-4e38-89e3-03efcb202dc4 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:23.798138 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:23.824804 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f698e-660a-4e38-89e3-03efcb202dc4 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:23.861995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a4d0f-69d6-456d-b7cf-e78a8200c542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:23.862657 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a4d0f-69d6-456d-b7cf-e78a8200c542 None admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:23.862954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a4d0f-69d6-456d-b7cf-e78a8200c542 None admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:23.863245 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a4d0f-69d6-456d-b7cf-e78a8200c542 None admin] PATH_INFO: `/v3/services` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:23.863954 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a4d0f-69d6-456d-b7cf-e78a8200c542 None admin] RBAC: Adding query filter params (name=placement) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:40:23.864266 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a4d0f-69d6-456d-b7cf-e78a8200c542 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:23.865653 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a4d0f-69d6-456d-b7cf-e78a8200c542 None admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:23.870847 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 461/926] 10.222.0.57 () {56 vars in 1116 bytes} [Sat Jul 2 20:40:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:40:23.877834 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b46425-f759-4b60-bde3-dfbe79e67e4b None admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:40:23.992225 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b46425-f759-4b60-bde3-dfbe79e67e4b None admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:40:24.027838 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d4d534-12d7-4f92-a45a-64924c0600b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:40:24.028478 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4d534-12d7-4f92-a45a-64924c0600b4 None admin] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:40:24.028760 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4d534-12d7-4f92-a45a-64924c0600b4 None admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:40:24.029033 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d4d534-12d7-4f92-a45a-64924c0600b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:40:24.029820 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4d534-12d7-4f92-a45a-64924c0600b4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:40:24.031223 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d4d534-12d7-4f92-a45a-64924c0600b4 None admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:40:24.053278 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 466/927] 10.222.0.57 () {60 vars in 1144 bytes} [Sat Jul 2 20:40:23 2022] POST /identity/v3/endpoints => generated 331 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:40:33.867759 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=30 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:40:34.049067 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:41:23.033294 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e306a2-22fb-4915-9649-0ed87fe8e316 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:23.033884 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e306a2-22fb-4915-9649-0ed87fe8e316 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:23.033884 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e306a2-22fb-4915-9649-0ed87fe8e316 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:23.037754 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 462/928] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:41:23.041296 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238542d-f825-44e5-92ce-72da66434c59 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:23.041829 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238542d-f825-44e5-92ce-72da66434c59 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:23.041829 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238542d-f825-44e5-92ce-72da66434c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:23.061900 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-5238542d-f825-44e5-92ce-72da66434c59 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:41:23.063353 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-5238542d-f825-44e5-92ce-72da66434c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:41:23.151072 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 467/929] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:41:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:41:23.205127 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad689aa3-2d0a-46af-8950-1850132fe2c3 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:23.205422 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad689aa3-2d0a-46af-8950-1850132fe2c3 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:23.205705 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad689aa3-2d0a-46af-8950-1850132fe2c3 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:23.207149 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 463/930] 10.222.0.57 () {54 vars in 964 bytes} [Sat Jul 2 20:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:41:23.216394 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ceba9-11b3-4841-ab59-eeae2afc12cd None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:23.219593 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ceba9-11b3-4841-ab59-eeae2afc12cd None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:23.219982 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ceba9-11b3-4841-ab59-eeae2afc12cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:23.281488 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-8c8ceba9-11b3-4841-ab59-eeae2afc12cd None None] MFA Rules not processed for user `bfcc022be567428db48e7b2a71d9c069`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:41:23.283516 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-8c8ceba9-11b3-4841-ab59-eeae2afc12cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:41:23.357234 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 468/931] 10.222.0.57 () {58 vars in 1061 bytes} [Sat Jul 2 20:41:23 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 20:41:23.366722 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad689aa3-2d0a-46af-8950-1850132fe2c3 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:41:23.379939 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad689aa3-2d0a-46af-8950-1850132fe2c3 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:41:23.383927 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6bba7-ea96-40c0-868d-fdb3c6e8cb6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:41:23.384591 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6bba7-ea96-40c0-868d-fdb3c6e8cb6e service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:23.384844 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6bba7-ea96-40c0-868d-fdb3c6e8cb6e service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:23.385114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6bba7-ea96-40c0-868d-fdb3c6e8cb6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:23.396136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6bba7-ea96-40c0-868d-fdb3c6e8cb6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:41:23.397982 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d6bba7-ea96-40c0-868d-fdb3c6e8cb6e service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:41:23.412187 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 464/932] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:41:23 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:41:26.008278 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20750eb8-f1e3-4852-a353-cf35e684c04a None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:26.008802 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20750eb8-f1e3-4852-a353-cf35e684c04a None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:26.008802 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20750eb8-f1e3-4852-a353-cf35e684c04a None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:26.010098 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 469/933] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:41:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:41:26.015506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5d9da-5029-4704-bf50-2066bb4398ee None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:26.015930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5d9da-5029-4704-bf50-2066bb4398ee None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:26.016052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5d9da-5029-4704-bf50-2066bb4398ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:26.035042 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-68a5d9da-5029-4704-bf50-2066bb4398ee None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:41:26.036241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-68a5d9da-5029-4704-bf50-2066bb4398ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:41:26.045052 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 465/934] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:41:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:41:26.084229 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20750eb8-f1e3-4852-a353-cf35e684c04a None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:41:26.095970 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20750eb8-f1e3-4852-a353-cf35e684c04a None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:41:26.099880 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64323e2-51fd-49d5-bb68-0575dabae0b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:41:26.100526 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64323e2-51fd-49d5-bb68-0575dabae0b7 service neutron] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:26.100802 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64323e2-51fd-49d5-bb68-0575dabae0b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:26.101094 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64323e2-51fd-49d5-bb68-0575dabae0b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:26.111150 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64323e2-51fd-49d5-bb68-0575dabae0b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:41:26.112590 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64323e2-51fd-49d5-bb68-0575dabae0b7 service neutron] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:41:26.122155 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 470/935] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:41:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:41:28.769366 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc8a88-ef38-47da-8ac3-e7f89d4a6f50 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:28.770061 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc8a88-ef38-47da-8ac3-e7f89d4a6f50 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:28.770061 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc8a88-ef38-47da-8ac3-e7f89d4a6f50 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:28.771550 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 466/936] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:41:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:41:28.778445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eca838-43dc-4937-bf88-a7ca142cb085 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:28.779251 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eca838-43dc-4937-bf88-a7ca142cb085 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:28.779251 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eca838-43dc-4937-bf88-a7ca142cb085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:28.818021 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-01eca838-43dc-4937-bf88-a7ca142cb085 None None] MFA Rules not processed for user `10854b3b3c7d41e986054d0f542ffe6e`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:41:28.819620 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-01eca838-43dc-4937-bf88-a7ca142cb085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:41:28.867458 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:41:28.906967 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 471/937] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:41:28 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 20:41:28.944491 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc8a88-ef38-47da-8ac3-e7f89d4a6f50 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:41:28.956987 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc8a88-ef38-47da-8ac3-e7f89d4a6f50 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:41:28.960500 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7fbac-8869-4fc9-a8a0-f45caa6f3104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:41:28.961165 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7fbac-8869-4fc9-a8a0-f45caa6f3104 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:28.961442 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7fbac-8869-4fc9-a8a0-f45caa6f3104 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:28.961709 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7fbac-8869-4fc9-a8a0-f45caa6f3104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:28.973193 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7fbac-8869-4fc9-a8a0-f45caa6f3104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:41:28.974619 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7fbac-8869-4fc9-a8a0-f45caa6f3104 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:41:28.985859 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 467/938] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:41:28 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:41:32.057888 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa42ea-1f85-4a4e-b8f0-c41ad6c0662f None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:32.058490 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa42ea-1f85-4a4e-b8f0-c41ad6c0662f None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:32.058490 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa42ea-1f85-4a4e-b8f0-c41ad6c0662f None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:32.060283 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 472/939] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:41:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:41:32.067509 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e3296-e543-4287-8064-8ecef79ce75e None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:32.068363 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e3296-e543-4287-8064-8ecef79ce75e None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:32.068363 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e3296-e543-4287-8064-8ecef79ce75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:32.094124 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-056e3296-e543-4287-8064-8ecef79ce75e None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:41:32.095647 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-056e3296-e543-4287-8064-8ecef79ce75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:41:32.196145 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 468/940] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:41:32 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:41:32.256410 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f577d-6442-406d-98ba-f1cdad218d1a None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:32.256715 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f577d-6442-406d-98ba-f1cdad218d1a None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:32.256991 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61f577d-6442-406d-98ba-f1cdad218d1a None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:32.260288 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 473/941] 10.222.0.57 () {54 vars in 964 bytes} [Sat Jul 2 20:41:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:41:32.268089 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68870c89-fa81-4947-bc8d-24b988266c66 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:32.268356 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68870c89-fa81-4947-bc8d-24b988266c66 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:32.268639 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68870c89-fa81-4947-bc8d-24b988266c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:32.291897 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-68870c89-fa81-4947-bc8d-24b988266c66 None None] MFA Rules not processed for user `bfcc022be567428db48e7b2a71d9c069`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:41:32.293639 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-68870c89-fa81-4947-bc8d-24b988266c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:41:32.304670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 469/942] 10.222.0.57 () {58 vars in 1061 bytes} [Sat Jul 2 20:41:32 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:41:32.314531 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f577d-6442-406d-98ba-f1cdad218d1a None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:41:32.328225 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61f577d-6442-406d-98ba-f1cdad218d1a None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:41:32.332713 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958029f9-7f27-42f6-9c6d-091dcc88e398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:41:32.333381 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958029f9-7f27-42f6-9c6d-091dcc88e398 service neutron] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:32.333751 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958029f9-7f27-42f6-9c6d-091dcc88e398 service neutron] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:32.334236 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958029f9-7f27-42f6-9c6d-091dcc88e398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:32.345861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958029f9-7f27-42f6-9c6d-091dcc88e398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:41:32.347411 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958029f9-7f27-42f6-9c6d-091dcc88e398 service neutron] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:41:32.360457 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 474/943] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:41:32 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:41:35.869531 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b15e22-f492-454d-b278-735a9ddf3987 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:35.870112 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b15e22-f492-454d-b278-735a9ddf3987 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:35.870112 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b15e22-f492-454d-b278-735a9ddf3987 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:35.871474 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 470/944] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:41:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:41:35.877854 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a8f1f-8b0f-4f6e-a0f7-a20b2b087904 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:35.878324 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a8f1f-8b0f-4f6e-a0f7-a20b2b087904 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:35.878416 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a8f1f-8b0f-4f6e-a0f7-a20b2b087904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:35.898224 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-7a3a8f1f-8b0f-4f6e-a0f7-a20b2b087904 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:41:35.899560 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-7a3a8f1f-8b0f-4f6e-a0f7-a20b2b087904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:41:35.909381 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 475/945] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:41:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:41:35.946749 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b15e22-f492-454d-b278-735a9ddf3987 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:41:35.958761 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b15e22-f492-454d-b278-735a9ddf3987 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:41:35.963187 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd38944-0558-49a7-8805-60b4d08d4739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:41:35.963905 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd38944-0558-49a7-8805-60b4d08d4739 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:35.964251 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd38944-0558-49a7-8805-60b4d08d4739 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:35.964588 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd38944-0558-49a7-8805-60b4d08d4739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:35.974368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd38944-0558-49a7-8805-60b4d08d4739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:41:35.975795 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd38944-0558-49a7-8805-60b4d08d4739 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:41:35.985563 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 471/946] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:41:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:41:38.341930 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7007b8-f2d1-4e1e-8216-731fc5f6e262 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:38.342516 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7007b8-f2d1-4e1e-8216-731fc5f6e262 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:38.342516 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7007b8-f2d1-4e1e-8216-731fc5f6e262 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:38.343888 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 476/947] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:41:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:41:38.349201 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad731fc7-0f0c-4b54-bfa9-de5a8c0da800 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:38.349632 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad731fc7-0f0c-4b54-bfa9-de5a8c0da800 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:38.349738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad731fc7-0f0c-4b54-bfa9-de5a8c0da800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:38.369049 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-ad731fc7-0f0c-4b54-bfa9-de5a8c0da800 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:41:38.370406 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-ad731fc7-0f0c-4b54-bfa9-de5a8c0da800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:41:38.379872 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 472/948] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:41:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:41:38.416102 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7007b8-f2d1-4e1e-8216-731fc5f6e262 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:41:38.428472 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7007b8-f2d1-4e1e-8216-731fc5f6e262 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:41:38.432479 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec040924-25b6-4aed-82f7-d2eee825a679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:41:38.433206 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec040924-25b6-4aed-82f7-d2eee825a679 service neutron] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:38.433549 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec040924-25b6-4aed-82f7-d2eee825a679 service neutron] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:38.433881 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec040924-25b6-4aed-82f7-d2eee825a679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:38.442979 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec040924-25b6-4aed-82f7-d2eee825a679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:41:38.444488 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec040924-25b6-4aed-82f7-d2eee825a679 service neutron] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:41:38.456330 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 477/949] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:41:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:41:40.776653 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecb9fb-1526-4b75-aad4-0548a3c651ca None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:40.777230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecb9fb-1526-4b75-aad4-0548a3c651ca None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:40.777230 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecb9fb-1526-4b75-aad4-0548a3c651ca None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:40.778570 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 473/950] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:41:40.784286 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b582866-ab79-4dda-820a-a088bb2496f7 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:40.784695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b582866-ab79-4dda-820a-a088bb2496f7 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:40.784867 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b582866-ab79-4dda-820a-a088bb2496f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:40.804271 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-2b582866-ab79-4dda-820a-a088bb2496f7 None None] MFA Rules not processed for user `10854b3b3c7d41e986054d0f542ffe6e`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:41:40.805466 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-2b582866-ab79-4dda-820a-a088bb2496f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:41:40.814862 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 478/951] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:41:40 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:41:40.854252 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecb9fb-1526-4b75-aad4-0548a3c651ca None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:41:40.866133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecb9fb-1526-4b75-aad4-0548a3c651ca None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:41:40.869846 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3423a88-250c-4d6e-84a2-2c5f6037ce4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:41:40.870492 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3423a88-250c-4d6e-84a2-2c5f6037ce4b service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:40.870779 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3423a88-250c-4d6e-84a2-2c5f6037ce4b service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:40.871138 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3423a88-250c-4d6e-84a2-2c5f6037ce4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:40.881911 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3423a88-250c-4d6e-84a2-2c5f6037ce4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:41:40.883407 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3423a88-250c-4d6e-84a2-2c5f6037ce4b service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:41:40.893369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 474/952] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:41:40 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:41:43.395600 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d198b-3e25-4e6e-be3b-435382b16f91 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:43.396149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d198b-3e25-4e6e-be3b-435382b16f91 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:43.396255 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d198b-3e25-4e6e-be3b-435382b16f91 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:43.397590 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 479/953] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:41:43.403054 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a5a07-eaba-4b52-8056-c9f160657244 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:43.403452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a5a07-eaba-4b52-8056-c9f160657244 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:43.403603 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a5a07-eaba-4b52-8056-c9f160657244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:43.422648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-6e1a5a07-eaba-4b52-8056-c9f160657244 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:41:43.424173 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-6e1a5a07-eaba-4b52-8056-c9f160657244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:41:43.433493 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 475/954] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:41:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:41:43.470795 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d198b-3e25-4e6e-be3b-435382b16f91 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:41:43.483996 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d198b-3e25-4e6e-be3b-435382b16f91 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:41:43.488478 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b2f65-5b90-4190-8008-44c15d32876c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:41:43.489157 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b2f65-5b90-4190-8008-44c15d32876c service neutron] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:43.489438 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b2f65-5b90-4190-8008-44c15d32876c service neutron] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:43.489711 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b2f65-5b90-4190-8008-44c15d32876c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:43.500335 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b2f65-5b90-4190-8008-44c15d32876c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:41:43.501904 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b2f65-5b90-4190-8008-44c15d32876c service neutron] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:41:43.513205 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 480/955] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:41:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:41:45.861568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6138a-d24c-4b90-9823-8b4c63dc82ef None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:45.862103 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6138a-d24c-4b90-9823-8b4c63dc82ef None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:45.862103 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f6138a-d24c-4b90-9823-8b4c63dc82ef None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:45.863542 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 476/956] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:41:45.869246 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3274d09-3094-4734-9157-821a519d9745 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:45.869764 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3274d09-3094-4734-9157-821a519d9745 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:45.869865 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3274d09-3094-4734-9157-821a519d9745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:45.889844 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-c3274d09-3094-4734-9157-821a519d9745 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:41:45.891210 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-c3274d09-3094-4734-9157-821a519d9745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:41:45.900162 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 481/957] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:41:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:41:45.941367 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6138a-d24c-4b90-9823-8b4c63dc82ef None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:41:45.946974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=68 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:41:45.953901 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f6138a-d24c-4b90-9823-8b4c63dc82ef None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:41:45.957965 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa983711-832b-4584-ab93-6c530364dda7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:41:45.958388 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa983711-832b-4584-ab93-6c530364dda7 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:45.958670 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa983711-832b-4584-ab93-6c530364dda7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:45.958967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa983711-832b-4584-ab93-6c530364dda7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:45.968961 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa983711-832b-4584-ab93-6c530364dda7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:41:45.970390 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa983711-832b-4584-ab93-6c530364dda7 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:41:45.979865 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 477/958] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:41:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:41:48.597501 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879df31a-aadf-4714-926d-3a12fd710fb9 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:48.598085 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879df31a-aadf-4714-926d-3a12fd710fb9 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:48.598085 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879df31a-aadf-4714-926d-3a12fd710fb9 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:48.600304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 482/959] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:41:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:41:48.609516 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a232e-52bf-4dc8-8778-ff16f81dd965 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:48.609932 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a232e-52bf-4dc8-8778-ff16f81dd965 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:48.610085 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a232e-52bf-4dc8-8778-ff16f81dd965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:48.633997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-711a232e-52bf-4dc8-8778-ff16f81dd965 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:41:48.635226 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-711a232e-52bf-4dc8-8778-ff16f81dd965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:41:48.644520 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 478/960] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:41:48 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:41:48.684075 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879df31a-aadf-4714-926d-3a12fd710fb9 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:41:48.696961 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879df31a-aadf-4714-926d-3a12fd710fb9 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:41:48.701149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04439254-9ea4-49c0-8525-7452357c1aea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:41:48.701775 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04439254-9ea4-49c0-8525-7452357c1aea service neutron] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:48.702051 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04439254-9ea4-49c0-8525-7452357c1aea service neutron] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:48.702635 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04439254-9ea4-49c0-8525-7452357c1aea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:48.712582 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04439254-9ea4-49c0-8525-7452357c1aea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:41:48.714003 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04439254-9ea4-49c0-8525-7452357c1aea service neutron] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:41:48.723583 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 483/961] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:41:48 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:41:53.076321 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80582911-37a8-457f-b0e7-441633005d31 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:53.076851 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80582911-37a8-457f-b0e7-441633005d31 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:53.076851 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80582911-37a8-457f-b0e7-441633005d31 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:53.078573 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 479/962] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:41:53.083851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13caceb7-e42c-47b6-b063-6335e68c6d71 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:53.084280 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13caceb7-e42c-47b6-b063-6335e68c6d71 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:53.084473 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13caceb7-e42c-47b6-b063-6335e68c6d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:53.103292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-13caceb7-e42c-47b6-b063-6335e68c6d71 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:41:53.104485 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-13caceb7-e42c-47b6-b063-6335e68c6d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:41:53.113876 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 484/963] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:41:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:41:53.153004 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80582911-37a8-457f-b0e7-441633005d31 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:41:53.164183 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80582911-37a8-457f-b0e7-441633005d31 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:41:53.167747 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7a2af-eb69-45f2-a085-0f1e05b0b3ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:41:53.168453 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7a2af-eb69-45f2-a085-0f1e05b0b3ee service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:53.168798 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7a2af-eb69-45f2-a085-0f1e05b0b3ee service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:53.169166 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7a2af-eb69-45f2-a085-0f1e05b0b3ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:53.178076 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7a2af-eb69-45f2-a085-0f1e05b0b3ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:41:53.179552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a7a2af-eb69-45f2-a085-0f1e05b0b3ee service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:41:53.189238 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 480/964] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:41:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 20:41:56.168606 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309357f-13b8-4141-8934-31867698c57f None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:56.169175 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309357f-13b8-4141-8934-31867698c57f None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:56.169657 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309357f-13b8-4141-8934-31867698c57f None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:56.171063 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 485/965] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:41:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:41:56.176457 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5887af4-0388-4872-a67d-40994ae8a18e None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:56.176884 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5887af4-0388-4872-a67d-40994ae8a18e None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:56.177007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5887af4-0388-4872-a67d-40994ae8a18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:56.195574 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-e5887af4-0388-4872-a67d-40994ae8a18e None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:41:56.196773 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-e5887af4-0388-4872-a67d-40994ae8a18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:41:56.206247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 481/966] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:41:56 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:41:56.244300 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309357f-13b8-4141-8934-31867698c57f None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:41:56.256791 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309357f-13b8-4141-8934-31867698c57f None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:41:56.260863 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b55a6d0-8781-49e0-849a-3a9e7eac3b82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:41:56.261514 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55a6d0-8781-49e0-849a-3a9e7eac3b82 service neutron] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:41:56.261796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55a6d0-8781-49e0-849a-3a9e7eac3b82 service neutron] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:41:56.262069 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b55a6d0-8781-49e0-849a-3a9e7eac3b82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:41:56.271701 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55a6d0-8781-49e0-849a-3a9e7eac3b82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:41:56.273125 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b55a6d0-8781-49e0-849a-3a9e7eac3b82 service neutron] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:41:56.282458 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 486/967] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:41:56 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:42:00.483083 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cbc27-94d2-430e-8ca6-08f9a3d2dc6b None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:00.483667 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cbc27-94d2-430e-8ca6-08f9a3d2dc6b None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:00.483667 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86cbc27-94d2-430e-8ca6-08f9a3d2dc6b None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:00.485025 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 482/968] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:42:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:42:00.490325 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c64630-5a67-495c-ba3b-a3128368b4b2 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:00.490750 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c64630-5a67-495c-ba3b-a3128368b4b2 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:00.490840 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c64630-5a67-495c-ba3b-a3128368b4b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:00.497740 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=54 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:42:00.511650 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-02c64630-5a67-495c-ba3b-a3128368b4b2 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:42:00.512866 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-02c64630-5a67-495c-ba3b-a3128368b4b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:42:00.521356 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 487/969] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:42:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:42:00.559834 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cbc27-94d2-430e-8ca6-08f9a3d2dc6b None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:42:00.578067 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86cbc27-94d2-430e-8ca6-08f9a3d2dc6b None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:42:00.582510 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d682d-440b-4165-84b7-6649c9e446e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:42:00.583201 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d682d-440b-4165-84b7-6649c9e446e5 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:00.583487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d682d-440b-4165-84b7-6649c9e446e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:00.583789 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d682d-440b-4165-84b7-6649c9e446e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:00.594105 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d682d-440b-4165-84b7-6649c9e446e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:42:00.595594 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d682d-440b-4165-84b7-6649c9e446e5 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:42:00.605233 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 483/970] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:42:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:42:06.135623 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35814782-9199-47ae-9783-46629cb61064 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:06.136507 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35814782-9199-47ae-9783-46629cb61064 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:06.136945 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35814782-9199-47ae-9783-46629cb61064 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:06.139560 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 488/971] 10.222.0.57 () {54 vars in 921 bytes} [Sat Jul 2 20:42:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:42:06.144857 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec237f2-e8ab-41fe-979c-e2d26840ab03 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:06.145295 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec237f2-e8ab-41fe-979c-e2d26840ab03 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:06.145407 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec237f2-e8ab-41fe-979c-e2d26840ab03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:06.198786 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-5ec237f2-e8ab-41fe-979c-e2d26840ab03 None None] MFA Rules not processed for user `f2377f751a584f678c0ddebc4de0ae44`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:42:06.200271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-5ec237f2-e8ab-41fe-979c-e2d26840ab03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:42:06.287908 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 484/972] 10.222.0.57 () {58 vars in 1018 bytes} [Sat Jul 2 20:42:06 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:42:10.506237 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=2 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:42:10.940847 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d6cde-d6ed-4287-82ee-d086c599f8dd None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:10.941351 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d6cde-d6ed-4287-82ee-d086c599f8dd None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:10.941745 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11d6cde-d6ed-4287-82ee-d086c599f8dd None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:10.943283 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 489/973] 10.222.0.57 () {54 vars in 921 bytes} [Sat Jul 2 20:42:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:42:10.948690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55949d2-2609-46a2-b4d2-cd80b3593247 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:10.949146 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55949d2-2609-46a2-b4d2-cd80b3593247 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:10.949234 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55949d2-2609-46a2-b4d2-cd80b3593247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:10.969563 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-b55949d2-2609-46a2-b4d2-cd80b3593247 None None] MFA Rules not processed for user `f2377f751a584f678c0ddebc4de0ae44`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:42:10.970862 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-b55949d2-2609-46a2-b4d2-cd80b3593247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:42:10.979955 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 485/974] 10.222.0.57 () {58 vars in 1018 bytes} [Sat Jul 2 20:42:10 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:42:12.235112 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d045a82-68a6-44fd-a05a-cefdfe156d31 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:12.235662 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d045a82-68a6-44fd-a05a-cefdfe156d31 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:12.235662 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d045a82-68a6-44fd-a05a-cefdfe156d31 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:12.237024 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 490/975] 10.222.0.57 () {54 vars in 921 bytes} [Sat Jul 2 20:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:42:12.241922 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae084e0-19c5-49e9-9175-0ee726affa94 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:12.242369 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae084e0-19c5-49e9-9175-0ee726affa94 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:12.242450 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae084e0-19c5-49e9-9175-0ee726affa94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:12.261464 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-1ae084e0-19c5-49e9-9175-0ee726affa94 None None] MFA Rules not processed for user `f2377f751a584f678c0ddebc4de0ae44`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:42:12.262885 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-1ae084e0-19c5-49e9-9175-0ee726affa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:42:12.273479 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 486/976] 10.222.0.57 () {58 vars in 1018 bytes} [Sat Jul 2 20:42:12 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:42:16.179775 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d954d4-d4d9-4ff6-9386-0f1ef719ee92 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:16.180329 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d954d4-d4d9-4ff6-9386-0f1ef719ee92 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:16.180329 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d954d4-d4d9-4ff6-9386-0f1ef719ee92 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:16.181799 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 491/977] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:42:16.187463 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a9839-c76f-4790-b01c-29f60eb2a19a None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:16.187875 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a9839-c76f-4790-b01c-29f60eb2a19a None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:16.188018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a9839-c76f-4790-b01c-29f60eb2a19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:16.194557 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=69 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:42:16.207519 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-e66a9839-c76f-4790-b01c-29f60eb2a19a None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:42:16.208702 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-e66a9839-c76f-4790-b01c-29f60eb2a19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:42:16.217631 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 487/978] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:42:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:42:16.271405 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09157404-68b1-4bd1-bbb5-0420993cfa2b None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:16.271873 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09157404-68b1-4bd1-bbb5-0420993cfa2b None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:16.272320 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09157404-68b1-4bd1-bbb5-0420993cfa2b None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:16.274215 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 492/979] 10.222.0.57 () {54 vars in 961 bytes} [Sat Jul 2 20:42:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:42:16.284216 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73359d25-0c5d-4ae7-8b96-021de95dec2c None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:16.284614 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73359d25-0c5d-4ae7-8b96-021de95dec2c None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:16.285058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73359d25-0c5d-4ae7-8b96-021de95dec2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:16.328427 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-73359d25-0c5d-4ae7-8b96-021de95dec2c None None] MFA Rules not processed for user `eec825336f2e408ebabdcfd29845d5ad`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:42:16.329635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-73359d25-0c5d-4ae7-8b96-021de95dec2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:42:16.403121 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 488/980] 10.222.0.57 () {58 vars in 1058 bytes} [Sat Jul 2 20:42:16 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:42:16.411250 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09157404-68b1-4bd1-bbb5-0420993cfa2b None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:42:16.425853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09157404-68b1-4bd1-bbb5-0420993cfa2b None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:42:16.430976 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2bb266-2856-46ed-aff4-21fb0795f5ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:42:16.431581 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bb266-2856-46ed-aff4-21fb0795f5ae service nova] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:16.431861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bb266-2856-46ed-aff4-21fb0795f5ae service nova] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:16.432131 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bb266-2856-46ed-aff4-21fb0795f5ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:16.441094 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2bb266-2856-46ed-aff4-21fb0795f5ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:42:16.442707 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2bb266-2856-46ed-aff4-21fb0795f5ae service nova] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:42:16.454219 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 493/981] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:42:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:42:18.997512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54823113-f458-4f5f-8ae1-e2e7198053e9 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:18.998021 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54823113-f458-4f5f-8ae1-e2e7198053e9 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:18.998021 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54823113-f458-4f5f-8ae1-e2e7198053e9 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:18.999642 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 489/982] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:42:19.005740 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f05cc8-756a-4b9c-91d2-8d977000743c None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:19.006198 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f05cc8-756a-4b9c-91d2-8d977000743c None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:19.006289 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f05cc8-756a-4b9c-91d2-8d977000743c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:19.025377 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-42f05cc8-756a-4b9c-91d2-8d977000743c None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:42:19.026548 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-42f05cc8-756a-4b9c-91d2-8d977000743c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:42:19.034499 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 494/983] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:42:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:42:19.080026 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54823113-f458-4f5f-8ae1-e2e7198053e9 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:42:19.095117 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54823113-f458-4f5f-8ae1-e2e7198053e9 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:42:19.099939 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02816cae-6428-4462-af44-ccaf519675b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:42:19.100581 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02816cae-6428-4462-af44-ccaf519675b5 service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:19.100861 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02816cae-6428-4462-af44-ccaf519675b5 service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:19.101131 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02816cae-6428-4462-af44-ccaf519675b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:19.109808 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02816cae-6428-4462-af44-ccaf519675b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:42:19.111416 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02816cae-6428-4462-af44-ccaf519675b5 service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:42:19.121261 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 490/984] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:42:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 20:42:21.763235 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b10ca1-c0e9-4f3a-be7f-31bf8875519f None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:21.764171 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b10ca1-c0e9-4f3a-be7f-31bf8875519f None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:21.764643 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b10ca1-c0e9-4f3a-be7f-31bf8875519f None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:21.766553 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 495/985] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:42:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:42:21.772130 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b2508-4ed2-4b9e-92e4-bcf3eb376c3d None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:21.772564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b2508-4ed2-4b9e-92e4-bcf3eb376c3d None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:21.772673 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b2508-4ed2-4b9e-92e4-bcf3eb376c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:21.792541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-742b2508-4ed2-4b9e-92e4-bcf3eb376c3d None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:42:21.793983 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-742b2508-4ed2-4b9e-92e4-bcf3eb376c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:42:21.802203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 491/986] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:42:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:42:21.848076 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ea2f5-cbe3-4e5a-9165-f15c31490fd6 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:21.848362 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ea2f5-cbe3-4e5a-9165-f15c31490fd6 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:21.848631 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ea2f5-cbe3-4e5a-9165-f15c31490fd6 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:21.850022 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 496/987] 10.222.0.57 () {54 vars in 961 bytes} [Sat Jul 2 20:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:42:21.855751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f71d5-0e55-4aba-ba11-552793c7cf6d None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:21.856204 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f71d5-0e55-4aba-ba11-552793c7cf6d None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:21.856521 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26f71d5-0e55-4aba-ba11-552793c7cf6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:21.875297 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-e26f71d5-0e55-4aba-ba11-552793c7cf6d None None] MFA Rules not processed for user `eec825336f2e408ebabdcfd29845d5ad`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:42:21.876485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-e26f71d5-0e55-4aba-ba11-552793c7cf6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:42:21.885893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 492/988] 10.222.0.57 () {58 vars in 1058 bytes} [Sat Jul 2 20:42:21 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 20:42:21.894318 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ea2f5-cbe3-4e5a-9165-f15c31490fd6 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:42:21.915488 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ea2f5-cbe3-4e5a-9165-f15c31490fd6 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:42:21.920676 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3928551c-e4b1-4566-b79a-e6623af7ddab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:42:21.921312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928551c-e4b1-4566-b79a-e6623af7ddab service nova] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:21.921587 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928551c-e4b1-4566-b79a-e6623af7ddab service nova] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:21.921890 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3928551c-e4b1-4566-b79a-e6623af7ddab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:21.930323 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928551c-e4b1-4566-b79a-e6623af7ddab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:42:21.931991 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3928551c-e4b1-4566-b79a-e6623af7ddab service nova] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:42:21.943859 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 497/989] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:42:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:42:24.384587 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868921cb-6490-4fdb-8c31-dcb47a64ccd4 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:24.385471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868921cb-6490-4fdb-8c31-dcb47a64ccd4 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:24.385926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868921cb-6490-4fdb-8c31-dcb47a64ccd4 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:24.388298 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 493/990] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:42:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:42:24.393518 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f6fb9-ad33-4a32-b88a-d7f7373132ed None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:24.394344 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f6fb9-ad33-4a32-b88a-d7f7373132ed None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:24.394771 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f6fb9-ad33-4a32-b88a-d7f7373132ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:24.414836 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-307f6fb9-ad33-4a32-b88a-d7f7373132ed None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:42:24.416290 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-307f6fb9-ad33-4a32-b88a-d7f7373132ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:42:24.426115 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 498/991] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:42:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:42:24.475923 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868921cb-6490-4fdb-8c31-dcb47a64ccd4 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:42:24.491423 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868921cb-6490-4fdb-8c31-dcb47a64ccd4 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:42:24.498490 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c4e67b-bdc0-4c96-bfd5-32d810a6465f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:42:24.499387 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4e67b-bdc0-4c96-bfd5-32d810a6465f service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:24.499848 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4e67b-bdc0-4c96-bfd5-32d810a6465f service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:24.500271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c4e67b-bdc0-4c96-bfd5-32d810a6465f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:24.510618 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4e67b-bdc0-4c96-bfd5-32d810a6465f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:42:24.513220 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c4e67b-bdc0-4c96-bfd5-32d810a6465f service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:42:24.525225 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 494/992] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:42:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:42:26.275226 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a9bac-1306-4890-8c18-0d4cf2f05a87 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:26.275794 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a9bac-1306-4890-8c18-0d4cf2f05a87 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:26.275794 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a9bac-1306-4890-8c18-0d4cf2f05a87 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:26.277130 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 499/993] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:42:26.282380 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd57a1-7214-4542-9a19-c6d1df8a1a19 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:26.282788 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd57a1-7214-4542-9a19-c6d1df8a1a19 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:26.282974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd57a1-7214-4542-9a19-c6d1df8a1a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:26.301412 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-d0bd57a1-7214-4542-9a19-c6d1df8a1a19 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:42:26.302858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-d0bd57a1-7214-4542-9a19-c6d1df8a1a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:42:26.311274 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 495/994] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:42:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:42:26.616758 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c354e7-e6d2-4b7b-b1c5-e71d84106717 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:26.616758 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c354e7-e6d2-4b7b-b1c5-e71d84106717 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:26.616758 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c354e7-e6d2-4b7b-b1c5-e71d84106717 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:26.618021 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 500/995] 10.222.0.57 () {54 vars in 963 bytes} [Sat Jul 2 20:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:42:26.623304 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179dcfe-2476-4937-98d6-795a46af93ae None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:26.623709 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179dcfe-2476-4937-98d6-795a46af93ae None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:26.624115 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7179dcfe-2476-4937-98d6-795a46af93ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:26.662518 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-7179dcfe-2476-4937-98d6-795a46af93ae None None] MFA Rules not processed for user `875c7134ed804201831348457be9d247`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:42:26.663753 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-7179dcfe-2476-4937-98d6-795a46af93ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:42:26.739359 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 496/996] 10.222.0.57 () {58 vars in 1060 bytes} [Sat Jul 2 20:42:26 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:42:26.747160 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c354e7-e6d2-4b7b-b1c5-e71d84106717 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:42:26.758489 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c354e7-e6d2-4b7b-b1c5-e71d84106717 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:42:26.762220 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1483b22f-8501-4e7a-ad5d-617e1e3eb5b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '875c7134ed804201831348457be9d247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:42:26.762897 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483b22f-8501-4e7a-ad5d-617e1e3eb5b3 service cinder] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:26.763198 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483b22f-8501-4e7a-ad5d-617e1e3eb5b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:26.763669 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1483b22f-8501-4e7a-ad5d-617e1e3eb5b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:26.775545 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1483b22f-8501-4e7a-ad5d-617e1e3eb5b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:42:26.777011 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1483b22f-8501-4e7a-ad5d-617e1e3eb5b3 service cinder] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:42:26.788223 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 501/997] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:42:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:42:26.958993 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52f79d-1e44-45a9-b6af-8834c50b3429 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:26.959278 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52f79d-1e44-45a9-b6af-8834c50b3429 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:26.959589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c52f79d-1e44-45a9-b6af-8834c50b3429 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:26.962976 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 497/998] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:42:26.967181 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b450a-669a-4510-bc73-415628221b88 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:26.967470 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b450a-669a-4510-bc73-415628221b88 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:26.967748 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74b450a-669a-4510-bc73-415628221b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:26.986502 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-f74b450a-669a-4510-bc73-415628221b88 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:42:26.987730 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-f74b450a-669a-4510-bc73-415628221b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:42:26.996139 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 502/999] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:42:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:42:27.041728 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52f79d-1e44-45a9-b6af-8834c50b3429 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:42:27.056341 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c52f79d-1e44-45a9-b6af-8834c50b3429 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:42:27.061720 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f984ac5-2885-4a16-bcc4-4fe5b3bc7ad4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:42:27.062374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f984ac5-2885-4a16-bcc4-4fe5b3bc7ad4 service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:27.062643 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f984ac5-2885-4a16-bcc4-4fe5b3bc7ad4 service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:27.062916 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f984ac5-2885-4a16-bcc4-4fe5b3bc7ad4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:27.071580 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f984ac5-2885-4a16-bcc4-4fe5b3bc7ad4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:42:27.073178 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f984ac5-2885-4a16-bcc4-4fe5b3bc7ad4 service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:42:27.077977 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:42:27.090445 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 498/1000] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:42:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:42:29.401844 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49bad7-cc39-4bf7-a407-ff90a19b4bd5 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:29.402384 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49bad7-cc39-4bf7-a407-ff90a19b4bd5 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:29.402384 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e49bad7-cc39-4bf7-a407-ff90a19b4bd5 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:29.403808 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 503/1001] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:42:29.409244 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf8af2-656c-4dc0-aac6-ecf35e506dac None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:29.409632 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf8af2-656c-4dc0-aac6-ecf35e506dac None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:29.409793 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf8af2-656c-4dc0-aac6-ecf35e506dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:29.428787 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-3ecf8af2-656c-4dc0-aac6-ecf35e506dac None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:42:29.429978 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-3ecf8af2-656c-4dc0-aac6-ecf35e506dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:42:29.438354 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 499/1002] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:42:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:42:29.483219 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49bad7-cc39-4bf7-a407-ff90a19b4bd5 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:42:29.497593 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e49bad7-cc39-4bf7-a407-ff90a19b4bd5 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:42:29.502663 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043bc03-169b-49b2-96e6-86fa97c15a6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:42:29.503725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043bc03-169b-49b2-96e6-86fa97c15a6f service nova] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:29.504004 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043bc03-169b-49b2-96e6-86fa97c15a6f service nova] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:29.504272 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043bc03-169b-49b2-96e6-86fa97c15a6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:29.513667 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043bc03-169b-49b2-96e6-86fa97c15a6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:42:29.515343 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043bc03-169b-49b2-96e6-86fa97c15a6f service nova] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:42:29.525202 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 504/1003] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:42:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:42:31.866705 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc494752-8d8a-496a-a05a-3d6eeb99c28e None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:31.867350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc494752-8d8a-496a-a05a-3d6eeb99c28e None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:31.867621 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc494752-8d8a-496a-a05a-3d6eeb99c28e None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:31.869769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 500/1004] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:42:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:42:31.874725 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdde68-4fbb-477e-bcc2-fcf4745a3c2f None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:31.875226 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdde68-4fbb-477e-bcc2-fcf4745a3c2f None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:31.875331 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdde68-4fbb-477e-bcc2-fcf4745a3c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:31.894364 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-fdbdde68-4fbb-477e-bcc2-fcf4745a3c2f None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:42:31.895576 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-fdbdde68-4fbb-477e-bcc2-fcf4745a3c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:42:31.904136 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 505/1005] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:42:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:42:31.946512 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc494752-8d8a-496a-a05a-3d6eeb99c28e None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:42:31.961103 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc494752-8d8a-496a-a05a-3d6eeb99c28e None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:42:31.966712 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc90c50-c341-4d24-8c9d-d0c097eb1451 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:42:31.967328 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc90c50-c341-4d24-8c9d-d0c097eb1451 service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:31.967612 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc90c50-c341-4d24-8c9d-d0c097eb1451 service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:31.967894 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc90c50-c341-4d24-8c9d-d0c097eb1451 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:31.977028 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc90c50-c341-4d24-8c9d-d0c097eb1451 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:42:31.978630 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc90c50-c341-4d24-8c9d-d0c097eb1451 service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:42:31.991324 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 501/1006] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:42:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:42:34.410957 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed9fbe-eb18-4104-a562-e2519f5c4e4a None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:34.411587 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed9fbe-eb18-4104-a562-e2519f5c4e4a None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:34.411587 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed9fbe-eb18-4104-a562-e2519f5c4e4a None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:34.412977 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 506/1007] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:42:34.419608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65c95a-0004-4f87-a61c-dc2546616d13 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:34.420218 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65c95a-0004-4f87-a61c-dc2546616d13 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:34.420218 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65c95a-0004-4f87-a61c-dc2546616d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:34.440593 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-cf65c95a-0004-4f87-a61c-dc2546616d13 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:42:34.441877 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-cf65c95a-0004-4f87-a61c-dc2546616d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:42:34.450545 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 502/1008] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:42:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:42:34.497230 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed9fbe-eb18-4104-a562-e2519f5c4e4a None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:42:34.512041 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed9fbe-eb18-4104-a562-e2519f5c4e4a None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:42:34.517604 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13d28a-00aa-4a20-bdcf-97ee48d37148 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:42:34.518244 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13d28a-00aa-4a20-bdcf-97ee48d37148 service nova] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:34.518523 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13d28a-00aa-4a20-bdcf-97ee48d37148 service nova] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:34.518793 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13d28a-00aa-4a20-bdcf-97ee48d37148 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:34.527241 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13d28a-00aa-4a20-bdcf-97ee48d37148 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:42:34.528910 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13d28a-00aa-4a20-bdcf-97ee48d37148 service nova] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:42:34.539226 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 507/1009] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:42:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:42:37.391858 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0ccc9-96ee-4459-9468-240e59123222 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:37.400400 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0ccc9-96ee-4459-9468-240e59123222 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:37.400400 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0ccc9-96ee-4459-9468-240e59123222 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:37.400400 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 503/1010] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:42:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:42:37.400763 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934ab5e-4f8f-4e78-ae98-96c7f06c3f88 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:37.401799 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934ab5e-4f8f-4e78-ae98-96c7f06c3f88 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:37.402128 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934ab5e-4f8f-4e78-ae98-96c7f06c3f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:37.425364 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-7934ab5e-4f8f-4e78-ae98-96c7f06c3f88 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:42:37.426637 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-7934ab5e-4f8f-4e78-ae98-96c7f06c3f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:42:37.435719 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 508/1011] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:42:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:42:37.484307 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0ccc9-96ee-4459-9468-240e59123222 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:42:37.498981 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0ccc9-96ee-4459-9468-240e59123222 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:42:37.504149 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d030f14-949f-41e8-be6b-6bc5e0c3db29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:42:37.504790 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d030f14-949f-41e8-be6b-6bc5e0c3db29 service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:37.505113 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d030f14-949f-41e8-be6b-6bc5e0c3db29 service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:37.505452 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d030f14-949f-41e8-be6b-6bc5e0c3db29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:37.515059 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d030f14-949f-41e8-be6b-6bc5e0c3db29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:42:37.516737 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d030f14-949f-41e8-be6b-6bc5e0c3db29 service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:42:37.527096 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 504/1012] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:42:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:42:40.739362 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4172b-898a-409d-82e5-fb329e27d950 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:40.739966 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4172b-898a-409d-82e5-fb329e27d950 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:40.739966 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d4172b-898a-409d-82e5-fb329e27d950 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:40.741262 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 509/1013] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:42:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:42:40.746616 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df642a1-a996-48bb-a749-8f246fadda31 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:40.747457 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df642a1-a996-48bb-a749-8f246fadda31 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:40.747457 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df642a1-a996-48bb-a749-8f246fadda31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:40.770733 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-0df642a1-a996-48bb-a749-8f246fadda31 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:42:40.771995 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-0df642a1-a996-48bb-a749-8f246fadda31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:42:40.781084 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 505/1014] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:42:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:42:40.827139 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4172b-898a-409d-82e5-fb329e27d950 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:42:40.839907 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=46 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:42:40.847303 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d4172b-898a-409d-82e5-fb329e27d950 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:42:40.852749 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4931ce3-05bc-4412-bdcc-0967c640317a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:42:40.853403 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4931ce3-05bc-4412-bdcc-0967c640317a service nova] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:40.853683 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4931ce3-05bc-4412-bdcc-0967c640317a service nova] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:40.853957 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4931ce3-05bc-4412-bdcc-0967c640317a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:40.862703 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4931ce3-05bc-4412-bdcc-0967c640317a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:42:40.864356 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4931ce3-05bc-4412-bdcc-0967c640317a service nova] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:42:40.874116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 510/1015] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:42:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:42:42.788360 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a713b1-2de0-470b-b00c-017defc4f110 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:42.788853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a713b1-2de0-470b-b00c-017defc4f110 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:42.788953 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a713b1-2de0-470b-b00c-017defc4f110 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:42.790325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 506/1016] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:42:42.795748 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e933b7-64db-4ef6-9459-0947ed372641 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:42.796229 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e933b7-64db-4ef6-9459-0947ed372641 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:42.796334 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e933b7-64db-4ef6-9459-0947ed372641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:42.814451 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-47e933b7-64db-4ef6-9459-0947ed372641 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:42:42.815683 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-47e933b7-64db-4ef6-9459-0947ed372641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:42:42.824318 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 511/1017] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:42:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:42:42.884327 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc26e1e-c57b-42f6-8cb8-a61c62836dee None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:42.884711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc26e1e-c57b-42f6-8cb8-a61c62836dee None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:42.885063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc26e1e-c57b-42f6-8cb8-a61c62836dee None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:42.886801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 507/1018] 10.222.0.57 () {54 vars in 962 bytes} [Sat Jul 2 20:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:42:42.892383 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8936e60-bbb6-478d-991a-e28c67d580ef None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:42.892672 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8936e60-bbb6-478d-991a-e28c67d580ef None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:42.892948 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8936e60-bbb6-478d-991a-e28c67d580ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:42.935327 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-d8936e60-bbb6-478d-991a-e28c67d580ef None None] MFA Rules not processed for user `bb3685e7474a40b0ba9115283446d430`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:42:42.937119 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-d8936e60-bbb6-478d-991a-e28c67d580ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:42:43.008597 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 512/1019] 10.222.0.57 () {58 vars in 1059 bytes} [Sat Jul 2 20:42:42 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:42:43.016286 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc26e1e-c57b-42f6-8cb8-a61c62836dee None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:42:43.028621 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc26e1e-c57b-42f6-8cb8-a61c62836dee None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:42:43.032499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3b228-0dee-4c28-bcde-ab7622e7f308 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3685e7474a40b0ba9115283446d430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:42:43.033262 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3b228-0dee-4c28-bcde-ab7622e7f308 service glance] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:43.033543 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3b228-0dee-4c28-bcde-ab7622e7f308 service glance] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:43.033814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3b228-0dee-4c28-bcde-ab7622e7f308 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:43.044288 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3b228-0dee-4c28-bcde-ab7622e7f308 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:42:43.045752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3b228-0dee-4c28-bcde-ab7622e7f308 service glance] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:42:43.055393 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 508/1020] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:42:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:42:43.177636 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cfcef-4c36-4492-a04e-70cea5fddae4 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:43.177925 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cfcef-4c36-4492-a04e-70cea5fddae4 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:43.178200 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7cfcef-4c36-4492-a04e-70cea5fddae4 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:43.179657 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 513/1021] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:42:43.185222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12b171-dd3e-4c4c-bcd2-b2fed94e1792 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:43.185509 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12b171-dd3e-4c4c-bcd2-b2fed94e1792 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:43.185783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12b171-dd3e-4c4c-bcd2-b2fed94e1792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:43.207864 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-6b12b171-dd3e-4c4c-bcd2-b2fed94e1792 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:42:43.209082 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-6b12b171-dd3e-4c4c-bcd2-b2fed94e1792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:42:43.218176 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 509/1022] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:42:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:42:43.264233 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cfcef-4c36-4492-a04e-70cea5fddae4 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:42:43.282542 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7cfcef-4c36-4492-a04e-70cea5fddae4 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:42:43.287460 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd93bc4c-15fc-4666-b65e-9eea4bb0898f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:42:43.288103 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93bc4c-15fc-4666-b65e-9eea4bb0898f service nova] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:43.288383 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93bc4c-15fc-4666-b65e-9eea4bb0898f service nova] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:43.288657 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd93bc4c-15fc-4666-b65e-9eea4bb0898f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:43.297500 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93bc4c-15fc-4666-b65e-9eea4bb0898f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:42:43.299126 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd93bc4c-15fc-4666-b65e-9eea4bb0898f service nova] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:42:43.309481 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 514/1023] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:42:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 20:42:45.647135 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a034cb3-2cc4-434e-b2ef-b18366fda039 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:45.647769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a034cb3-2cc4-434e-b2ef-b18366fda039 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:45.647769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a034cb3-2cc4-434e-b2ef-b18366fda039 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:45.649101 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 510/1024] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:42:45.654761 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7647fd-038a-496e-9174-0a966b179a2f None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:45.655254 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7647fd-038a-496e-9174-0a966b179a2f None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:45.655347 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7647fd-038a-496e-9174-0a966b179a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:45.677118 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-8c7647fd-038a-496e-9174-0a966b179a2f None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:42:45.678341 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-8c7647fd-038a-496e-9174-0a966b179a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:42:45.692080 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 515/1025] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:42:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:42:45.737757 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a034cb3-2cc4-434e-b2ef-b18366fda039 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:42:45.754148 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a034cb3-2cc4-434e-b2ef-b18366fda039 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:42:45.759815 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f714f57-2854-4295-8e45-0ad315f845ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:42:45.760471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f714f57-2854-4295-8e45-0ad315f845ce service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:45.762438 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f714f57-2854-4295-8e45-0ad315f845ce service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:45.762438 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f714f57-2854-4295-8e45-0ad315f845ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:45.770214 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f714f57-2854-4295-8e45-0ad315f845ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:42:45.771838 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f714f57-2854-4295-8e45-0ad315f845ce service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:42:45.783922 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 511/1026] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:42:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:42:55.670100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=50 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:42:55.777326 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=37 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:42:58.519238 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842c882-50b8-43a1-9fd4-a88a334b822a None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:58.519896 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842c882-50b8-43a1-9fd4-a88a334b822a None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:58.519896 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8842c882-50b8-43a1-9fd4-a88a334b822a None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:58.521133 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 516/1027] 10.222.0.57 () {54 vars in 918 bytes} [Sat Jul 2 20:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:42:58.527018 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d7131-1fee-4ae7-a8f9-cdf4bec1f2c2 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:58.527707 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d7131-1fee-4ae7-a8f9-cdf4bec1f2c2 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:58.527865 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d7131-1fee-4ae7-a8f9-cdf4bec1f2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:58.553300 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-b62d7131-1fee-4ae7-a8f9-cdf4bec1f2c2 None None] MFA Rules not processed for user `f2377f751a584f678c0ddebc4de0ae44`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:42:58.555190 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-b62d7131-1fee-4ae7-a8f9-cdf4bec1f2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:42:58.565769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 512/1028] 10.222.0.57 () {58 vars in 1015 bytes} [Sat Jul 2 20:42:58 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:42:58.581260 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f68bfc-bf5c-4622-bdff-4167f69bec23 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:58.581559 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f68bfc-bf5c-4622-bdff-4167f69bec23 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:58.581838 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f68bfc-bf5c-4622-bdff-4167f69bec23 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:58.583316 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 517/1029] 10.222.0.57 () {54 vars in 918 bytes} [Sat Jul 2 20:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:42:58.588835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74645e94-e70b-436b-ba1f-0ed9fcb5b594 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:42:58.589203 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74645e94-e70b-436b-ba1f-0ed9fcb5b594 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:42:58.589608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74645e94-e70b-436b-ba1f-0ed9fcb5b594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:42:58.613612 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-74645e94-e70b-436b-ba1f-0ed9fcb5b594 None None] MFA Rules not processed for user `eec825336f2e408ebabdcfd29845d5ad`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:42:58.614809 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-74645e94-e70b-436b-ba1f-0ed9fcb5b594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:42:58.624458 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 513/1030] 10.222.0.57 () {58 vars in 1015 bytes} [Sat Jul 2 20:42:58 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:43:01.400024 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65751a-fed9-4280-9a4b-930718e1c830 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:01.400646 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65751a-fed9-4280-9a4b-930718e1c830 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:01.400646 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab65751a-fed9-4280-9a4b-930718e1c830 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:01.401939 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 518/1031] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:01.408532 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20337719-905b-4e0a-aaeb-7edc19d29633 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:01.409177 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20337719-905b-4e0a-aaeb-7edc19d29633 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:01.409359 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20337719-905b-4e0a-aaeb-7edc19d29633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:01.437212 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-20337719-905b-4e0a-aaeb-7edc19d29633 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:01.438420 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-20337719-905b-4e0a-aaeb-7edc19d29633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:01.447998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 514/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:43:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:43:01.494626 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65751a-fed9-4280-9a4b-930718e1c830 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:01.509443 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab65751a-fed9-4280-9a4b-930718e1c830 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:01.515314 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b38ff-afc4-4bb9-af78-4250fe79c74c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:01.515954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b38ff-afc4-4bb9-af78-4250fe79c74c service nova] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:01.516230 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b38ff-afc4-4bb9-af78-4250fe79c74c service nova] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:01.516498 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b38ff-afc4-4bb9-af78-4250fe79c74c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:01.524651 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b38ff-afc4-4bb9-af78-4250fe79c74c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:01.526246 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b38ff-afc4-4bb9-af78-4250fe79c74c service nova] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:01.535891 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 519/1033] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:43:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:43:02.494168 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425edccf-f219-4bdc-a788-398af8fb1e02 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:02.494773 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425edccf-f219-4bdc-a788-398af8fb1e02 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:02.494773 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425edccf-f219-4bdc-a788-398af8fb1e02 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:02.496131 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 515/1034] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 20:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:02.504345 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f88df-c29f-40df-a239-8370430212b0 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:02.505058 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f88df-c29f-40df-a239-8370430212b0 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:02.505235 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f88df-c29f-40df-a239-8370430212b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:02.526535 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-db9f88df-c29f-40df-a239-8370430212b0 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:02.527848 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-db9f88df-c29f-40df-a239-8370430212b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:02.536229 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 520/1035] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 20:43:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:43:02.743709 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425edccf-f219-4bdc-a788-398af8fb1e02 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:02.760136 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425edccf-f219-4bdc-a788-398af8fb1e02 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:02.765859 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9801c8-c83b-4524-bcd5-8abd38f7f413 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:02.766497 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9801c8-c83b-4524-bcd5-8abd38f7f413 service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:02.766772 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9801c8-c83b-4524-bcd5-8abd38f7f413 service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:02.767107 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9801c8-c83b-4524-bcd5-8abd38f7f413 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:02.776390 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9801c8-c83b-4524-bcd5-8abd38f7f413 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:02.778112 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9801c8-c83b-4524-bcd5-8abd38f7f413 service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:02.788643 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 516/1036] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:43:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:43:03.681419 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7f16a-fdd4-42d9-941b-33d37c5622e7 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:03.682013 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7f16a-fdd4-42d9-941b-33d37c5622e7 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:03.682013 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb7f16a-fdd4-42d9-941b-33d37c5622e7 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:03.683669 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 521/1037] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 20:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:03.692144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4019ec-30ce-4440-a572-9e01cfd9a2ca None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:03.692869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4019ec-30ce-4440-a572-9e01cfd9a2ca None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:03.693119 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4019ec-30ce-4440-a572-9e01cfd9a2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:03.720114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-5a4019ec-30ce-4440-a572-9e01cfd9a2ca None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:03.721374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-5a4019ec-30ce-4440-a572-9e01cfd9a2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:03.730608 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 517/1038] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 20:43:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:43:03.883699 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7f16a-fdd4-42d9-941b-33d37c5622e7 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:03.900214 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb7f16a-fdd4-42d9-941b-33d37c5622e7 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:03.906206 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ef14c-32ad-4f60-9272-0671aedd2863 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:03.906844 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ef14c-32ad-4f60-9272-0671aedd2863 service nova] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:03.907154 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ef14c-32ad-4f60-9272-0671aedd2863 service nova] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:03.907422 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ef14c-32ad-4f60-9272-0671aedd2863 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:03.915800 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ef14c-32ad-4f60-9272-0671aedd2863 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:03.917379 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72ef14c-32ad-4f60-9272-0671aedd2863 service nova] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:03.927251 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 522/1039] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:43:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:43:04.793061 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e11b05-2445-4acc-8e2d-244efcd248af None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:04.793632 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e11b05-2445-4acc-8e2d-244efcd248af None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:04.793763 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e11b05-2445-4acc-8e2d-244efcd248af None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:04.795897 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 518/1040] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 20:43:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:04.800890 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4108eb6-c460-46a4-8496-b4cd79db9ea5 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:04.801346 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4108eb6-c460-46a4-8496-b4cd79db9ea5 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:04.801453 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4108eb6-c460-46a4-8496-b4cd79db9ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:04.821176 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-d4108eb6-c460-46a4-8496-b4cd79db9ea5 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:04.822413 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-d4108eb6-c460-46a4-8496-b4cd79db9ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:04.831781 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 523/1041] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 20:43:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:43:04.986416 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e11b05-2445-4acc-8e2d-244efcd248af None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:05.005446 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e11b05-2445-4acc-8e2d-244efcd248af None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:05.011382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b69d2f-2f21-4684-a4c6-8609be9ac25a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:05.012207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b69d2f-2f21-4684-a4c6-8609be9ac25a service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:05.012481 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b69d2f-2f21-4684-a4c6-8609be9ac25a service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:05.012748 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b69d2f-2f21-4684-a4c6-8609be9ac25a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:05.020989 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b69d2f-2f21-4684-a4c6-8609be9ac25a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:05.022614 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b69d2f-2f21-4684-a4c6-8609be9ac25a service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:05.032539 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 519/1042] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:43:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:43:05.902281 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e333e-e580-4f8b-8300-69ed7e4a2393 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:05.902843 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e333e-e580-4f8b-8300-69ed7e4a2393 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:05.903355 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e333e-e580-4f8b-8300-69ed7e4a2393 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:05.905506 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 524/1043] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 20:43:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:05.913680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc0fc9-9a77-438e-b00d-e1656ad4a3dd None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:05.914113 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc0fc9-9a77-438e-b00d-e1656ad4a3dd None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:05.914246 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbc0fc9-9a77-438e-b00d-e1656ad4a3dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:05.940794 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-abbc0fc9-9a77-438e-b00d-e1656ad4a3dd None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:05.941991 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-abbc0fc9-9a77-438e-b00d-e1656ad4a3dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:05.951676 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 520/1044] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 20:43:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:43:06.108040 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e333e-e580-4f8b-8300-69ed7e4a2393 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:06.123868 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e333e-e580-4f8b-8300-69ed7e4a2393 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:06.129564 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc66f2b-de60-4179-a6da-6bdba0b79988 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:06.130204 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc66f2b-de60-4179-a6da-6bdba0b79988 service nova] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:06.130478 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc66f2b-de60-4179-a6da-6bdba0b79988 service nova] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:06.130746 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc66f2b-de60-4179-a6da-6bdba0b79988 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:06.140194 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc66f2b-de60-4179-a6da-6bdba0b79988 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:06.141794 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc66f2b-de60-4179-a6da-6bdba0b79988 service nova] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:06.152002 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 525/1045] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:43:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:43:06.965263 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08817cbb-bfe6-4eb3-ae1d-a850a6f6ab91 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:06.965845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08817cbb-bfe6-4eb3-ae1d-a850a6f6ab91 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:06.965845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08817cbb-bfe6-4eb3-ae1d-a850a6f6ab91 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:06.967374 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 521/1046] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 20:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:06.973259 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dc991-97a0-47b2-9b84-f89e3e09d923 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:06.973986 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dc991-97a0-47b2-9b84-f89e3e09d923 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:06.974173 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697dc991-97a0-47b2-9b84-f89e3e09d923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:06.996143 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-697dc991-97a0-47b2-9b84-f89e3e09d923 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:06.997352 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-697dc991-97a0-47b2-9b84-f89e3e09d923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:07.006947 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 526/1047] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 20:43:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:43:07.171983 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08817cbb-bfe6-4eb3-ae1d-a850a6f6ab91 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:07.191398 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08817cbb-bfe6-4eb3-ae1d-a850a6f6ab91 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:07.197359 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c613cb7-199f-4654-9281-80896336e7a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:07.198004 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c613cb7-199f-4654-9281-80896336e7a3 service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:07.198279 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c613cb7-199f-4654-9281-80896336e7a3 service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:07.198540 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c613cb7-199f-4654-9281-80896336e7a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:07.207731 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c613cb7-199f-4654-9281-80896336e7a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:07.209336 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c613cb7-199f-4654-9281-80896336e7a3 service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:07.219579 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 522/1048] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:43:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:43:08.047353 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a88e6-c378-46a1-a784-9f256ff678c2 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:08.048189 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a88e6-c378-46a1-a784-9f256ff678c2 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:08.048189 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4a88e6-c378-46a1-a784-9f256ff678c2 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:08.050421 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 527/1049] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 20:43:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:08.056620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8270f-c5cc-42d0-bb5f-e6392cb383e8 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:08.057371 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8270f-c5cc-42d0-bb5f-e6392cb383e8 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:08.057601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8270f-c5cc-42d0-bb5f-e6392cb383e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:08.077648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-dfb8270f-c5cc-42d0-bb5f-e6392cb383e8 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:08.078842 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-dfb8270f-c5cc-42d0-bb5f-e6392cb383e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:08.088192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 523/1050] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 20:43:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:43:08.244486 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a88e6-c378-46a1-a784-9f256ff678c2 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:08.265817 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4a88e6-c378-46a1-a784-9f256ff678c2 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:08.272114 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ae8aeb-4784-4389-b0de-b78ced512a0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:08.272754 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae8aeb-4784-4389-b0de-b78ced512a0c service nova] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:08.273033 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae8aeb-4784-4389-b0de-b78ced512a0c service nova] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:08.273306 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ae8aeb-4784-4389-b0de-b78ced512a0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:08.281923 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae8aeb-4784-4389-b0de-b78ced512a0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:08.283547 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ae8aeb-4784-4389-b0de-b78ced512a0c service nova] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:08.293320 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 528/1051] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:43:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:43:09.116623 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6150ed9-6cec-475f-b3cb-004704e48f7a None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:09.117201 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6150ed9-6cec-475f-b3cb-004704e48f7a None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:09.117201 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6150ed9-6cec-475f-b3cb-004704e48f7a None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:09.118579 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 524/1052] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 20:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:09.125174 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23147b93-4caa-4261-80a2-4cb3165d7a72 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:09.125926 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23147b93-4caa-4261-80a2-4cb3165d7a72 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:09.126072 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23147b93-4caa-4261-80a2-4cb3165d7a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:09.151706 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-23147b93-4caa-4261-80a2-4cb3165d7a72 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:09.152987 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-23147b93-4caa-4261-80a2-4cb3165d7a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:09.163802 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 529/1053] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 20:43:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:43:09.318796 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6150ed9-6cec-475f-b3cb-004704e48f7a None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:09.335497 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6150ed9-6cec-475f-b3cb-004704e48f7a None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:09.341227 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2096c-3ba6-4435-b1b1-d6595d792d75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:09.341861 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2096c-3ba6-4435-b1b1-d6595d792d75 service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:09.342139 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2096c-3ba6-4435-b1b1-d6595d792d75 service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:09.342412 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2096c-3ba6-4435-b1b1-d6595d792d75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:09.351063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2096c-3ba6-4435-b1b1-d6595d792d75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:09.352635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2096c-3ba6-4435-b1b1-d6595d792d75 service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:09.362258 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 525/1054] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:43:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:43:10.175606 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c3ffa-91d9-41aa-8e85-30df6be8b264 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:10.176199 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c3ffa-91d9-41aa-8e85-30df6be8b264 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:10.176199 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c3ffa-91d9-41aa-8e85-30df6be8b264 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:10.177906 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 530/1055] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 20:43:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:10.184788 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e34df4-9d08-4e0c-9739-89cc69b5ba78 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:10.185275 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e34df4-9d08-4e0c-9739-89cc69b5ba78 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:10.185377 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e34df4-9d08-4e0c-9739-89cc69b5ba78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:10.215635 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-34e34df4-9d08-4e0c-9739-89cc69b5ba78 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:10.216846 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-34e34df4-9d08-4e0c-9739-89cc69b5ba78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:10.226441 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 526/1056] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 20:43:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:43:10.388478 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c3ffa-91d9-41aa-8e85-30df6be8b264 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:10.408641 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c3ffa-91d9-41aa-8e85-30df6be8b264 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:10.414727 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e5338e-dc0e-46d5-8108-5389674b5eae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:10.415384 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5338e-dc0e-46d5-8108-5389674b5eae service nova] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:10.415663 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5338e-dc0e-46d5-8108-5389674b5eae service nova] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:10.415927 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e5338e-dc0e-46d5-8108-5389674b5eae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:10.424683 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5338e-dc0e-46d5-8108-5389674b5eae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:10.426381 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e5338e-dc0e-46d5-8108-5389674b5eae service nova] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:10.447501 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 531/1057] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:43:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:43:12.605306 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4331279-bede-4dc7-afb4-4fdc0302f38b None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:12.606116 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4331279-bede-4dc7-afb4-4fdc0302f38b None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:12.606210 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4331279-bede-4dc7-afb4-4fdc0302f38b None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:12.608491 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 527/1058] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:43:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:12.613970 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7c5d2-c60f-4106-9685-4a8b6a7feb82 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:12.614393 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7c5d2-c60f-4106-9685-4a8b6a7feb82 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:12.614510 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7c5d2-c60f-4106-9685-4a8b6a7feb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:12.632560 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-4eb7c5d2-c60f-4106-9685-4a8b6a7feb82 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:12.633742 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-4eb7c5d2-c60f-4106-9685-4a8b6a7feb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:12.642164 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 532/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:43:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:43:12.681253 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4331279-bede-4dc7-afb4-4fdc0302f38b None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:12.694869 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4331279-bede-4dc7-afb4-4fdc0302f38b None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:12.700333 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec52ca-2b09-4753-bc90-b6d0caf764b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:12.700980 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec52ca-2b09-4753-bc90-b6d0caf764b7 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:12.701258 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec52ca-2b09-4753-bc90-b6d0caf764b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:12.701531 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec52ca-2b09-4753-bc90-b6d0caf764b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:12.713352 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec52ca-2b09-4753-bc90-b6d0caf764b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:12.715259 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec52ca-2b09-4753-bc90-b6d0caf764b7 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:12.725190 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 528/1060] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:43:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:43:15.118073 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790afa2-2f78-4e60-b67d-9370ec21820a None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:15.118670 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790afa2-2f78-4e60-b67d-9370ec21820a None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:15.118670 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790afa2-2f78-4e60-b67d-9370ec21820a None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:15.120018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 533/1061] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:15.126457 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5f7cd-b718-459f-8d7a-092d7920bdd6 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:15.127222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5f7cd-b718-459f-8d7a-092d7920bdd6 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:15.127409 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5f7cd-b718-459f-8d7a-092d7920bdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:15.147756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-aff5f7cd-b718-459f-8d7a-092d7920bdd6 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:15.148950 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-aff5f7cd-b718-459f-8d7a-092d7920bdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:15.157295 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 529/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:43:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:43:15.195662 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790afa2-2f78-4e60-b67d-9370ec21820a None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:15.210167 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790afa2-2f78-4e60-b67d-9370ec21820a None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:15.218077 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986b2b6c-92ea-4e28-ba63-9481986f1d68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:15.218815 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b2b6c-92ea-4e28-ba63-9481986f1d68 service neutron] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:15.219216 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b2b6c-92ea-4e28-ba63-9481986f1d68 service neutron] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:15.219594 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986b2b6c-92ea-4e28-ba63-9481986f1d68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:15.236701 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b2b6c-92ea-4e28-ba63-9481986f1d68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:15.238288 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986b2b6c-92ea-4e28-ba63-9481986f1d68 service neutron] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:15.249029 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 534/1063] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:43:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:43:17.866392 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ffb6d-2f42-4060-a123-3964b2edd56a None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:17.867002 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ffb6d-2f42-4060-a123-3964b2edd56a None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:17.867002 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ffb6d-2f42-4060-a123-3964b2edd56a None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:17.868335 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 530/1064] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:17.874721 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b6f17-2e51-448d-93fb-3ab6fdc3f3cd None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:17.875517 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b6f17-2e51-448d-93fb-3ab6fdc3f3cd None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:17.875696 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b6f17-2e51-448d-93fb-3ab6fdc3f3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:17.903066 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-737b6f17-2e51-448d-93fb-3ab6fdc3f3cd None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:17.904174 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-737b6f17-2e51-448d-93fb-3ab6fdc3f3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:17.912527 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 535/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:43:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:43:17.956827 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ffb6d-2f42-4060-a123-3964b2edd56a None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:17.969388 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ffb6d-2f42-4060-a123-3964b2edd56a None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:17.973779 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee8e99-b240-4829-81bc-73d7b51365cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:17.974430 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee8e99-b240-4829-81bc-73d7b51365cc service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:17.974711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee8e99-b240-4829-81bc-73d7b51365cc service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:17.975017 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee8e99-b240-4829-81bc-73d7b51365cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:17.985083 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee8e99-b240-4829-81bc-73d7b51365cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:17.986521 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee8e99-b240-4829-81bc-73d7b51365cc service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:17.996784 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 531/1066] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:43:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:43:20.411910 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b2242-0cdb-414d-b13b-ac238d08c3fb None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:20.412502 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b2242-0cdb-414d-b13b-ac238d08c3fb None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:20.412502 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07b2242-0cdb-414d-b13b-ac238d08c3fb None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:20.413783 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 536/1067] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:20.420358 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4a832-5520-4a0e-8e34-0790209ca2b0 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:20.420820 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4a832-5520-4a0e-8e34-0790209ca2b0 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:20.420926 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c4a832-5520-4a0e-8e34-0790209ca2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:20.449765 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-88c4a832-5520-4a0e-8e34-0790209ca2b0 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:20.450996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-88c4a832-5520-4a0e-8e34-0790209ca2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:20.461007 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 532/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:43:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:43:20.503256 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b2242-0cdb-414d-b13b-ac238d08c3fb None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:20.515423 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07b2242-0cdb-414d-b13b-ac238d08c3fb None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:20.520207 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6a3b0-52eb-4668-a076-3d117a96a7f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:20.520855 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6a3b0-52eb-4668-a076-3d117a96a7f4 service neutron] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:20.521130 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6a3b0-52eb-4668-a076-3d117a96a7f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:20.521422 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6a3b0-52eb-4668-a076-3d117a96a7f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:20.535688 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6a3b0-52eb-4668-a076-3d117a96a7f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:20.537831 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6a3b0-52eb-4668-a076-3d117a96a7f4 service neutron] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:20.547527 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 537/1069] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:43:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 20:43:22.867718 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8dc29-f2ff-4c70-b20d-940221974124 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:22.868554 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8dc29-f2ff-4c70-b20d-940221974124 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:22.868554 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e8dc29-f2ff-4c70-b20d-940221974124 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:22.870740 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 533/1070] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:43:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:22.876458 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39701ff-5101-4b99-8ff9-04e1b07cfa73 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:22.876881 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39701ff-5101-4b99-8ff9-04e1b07cfa73 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:22.876975 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39701ff-5101-4b99-8ff9-04e1b07cfa73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:22.895855 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-b39701ff-5101-4b99-8ff9-04e1b07cfa73 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:22.897079 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-b39701ff-5101-4b99-8ff9-04e1b07cfa73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:22.906532 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 538/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:43:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:43:22.947327 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8dc29-f2ff-4c70-b20d-940221974124 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:22.961775 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e8dc29-f2ff-4c70-b20d-940221974124 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:22.966456 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da794492-bd07-4952-a477-6f71e849df04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:22.967059 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da794492-bd07-4952-a477-6f71e849df04 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:22.967345 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da794492-bd07-4952-a477-6f71e849df04 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:22.967603 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da794492-bd07-4952-a477-6f71e849df04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:22.977079 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da794492-bd07-4952-a477-6f71e849df04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:22.978571 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da794492-bd07-4952-a477-6f71e849df04 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:22.988326 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 534/1072] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:43:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:43:25.400748 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d844643-21f2-4cfd-b99d-3f0a24568e51 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:25.401669 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d844643-21f2-4cfd-b99d-3f0a24568e51 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:25.401669 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d844643-21f2-4cfd-b99d-3f0a24568e51 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:25.403119 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 539/1073] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:25.409310 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d24c0b-11ee-4ab9-a2b7-2df058120e31 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:25.409783 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d24c0b-11ee-4ab9-a2b7-2df058120e31 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:25.409891 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d24c0b-11ee-4ab9-a2b7-2df058120e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:25.436485 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-52d24c0b-11ee-4ab9-a2b7-2df058120e31 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:25.437684 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-52d24c0b-11ee-4ab9-a2b7-2df058120e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:25.446357 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 535/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:43:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:43:25.489848 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d844643-21f2-4cfd-b99d-3f0a24568e51 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:25.502049 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d844643-21f2-4cfd-b99d-3f0a24568e51 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:25.505773 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72a93e4-4ab5-40ff-bcf2-ed63fbf51d17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:25.506394 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a93e4-4ab5-40ff-bcf2-ed63fbf51d17 service neutron] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:25.506671 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a93e4-4ab5-40ff-bcf2-ed63fbf51d17 service neutron] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:25.506972 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a93e4-4ab5-40ff-bcf2-ed63fbf51d17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:25.515901 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a93e4-4ab5-40ff-bcf2-ed63fbf51d17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:25.517338 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72a93e4-4ab5-40ff-bcf2-ed63fbf51d17 service neutron] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:25.526778 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 540/1075] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:43:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:43:27.864520 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4af5d-6235-41d3-a3f3-29ff58c4fb28 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:27.865147 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4af5d-6235-41d3-a3f3-29ff58c4fb28 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:27.865147 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef4af5d-6235-41d3-a3f3-29ff58c4fb28 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:27.866477 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 536/1076] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:43:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:27.873997 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc8c39-6474-4606-97f2-fb3bf82802f7 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:27.874574 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc8c39-6474-4606-97f2-fb3bf82802f7 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:27.874574 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc8c39-6474-4606-97f2-fb3bf82802f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:27.883641 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=70 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:27.897169 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-18fc8c39-6474-4606-97f2-fb3bf82802f7 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:27.898364 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-18fc8c39-6474-4606-97f2-fb3bf82802f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:27.906991 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 541/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:43:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:43:27.944998 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4af5d-6235-41d3-a3f3-29ff58c4fb28 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:27.951633 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=73 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:27.958959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef4af5d-6235-41d3-a3f3-29ff58c4fb28 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:27.962620 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f0b86-8ca9-41e6-9940-34b9e3817ea7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:27.963319 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f0b86-8ca9-41e6-9940-34b9e3817ea7 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:27.963600 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f0b86-8ca9-41e6-9940-34b9e3817ea7 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:27.963958 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f0b86-8ca9-41e6-9940-34b9e3817ea7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:27.973208 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f0b86-8ca9-41e6-9940-34b9e3817ea7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:27.974640 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138f0b86-8ca9-41e6-9940-34b9e3817ea7 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:27.984715 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 537/1078] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:43:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:43:30.374365 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa09226-8663-4be4-ab9c-a287aa043ddd None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:30.375417 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa09226-8663-4be4-ab9c-a287aa043ddd None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:30.375568 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa09226-8663-4be4-ab9c-a287aa043ddd None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:30.377674 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 542/1079] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:43:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:30.384028 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bef7c-5855-4d1f-8bd6-6586987a1887 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:30.384742 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bef7c-5855-4d1f-8bd6-6586987a1887 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:30.384915 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bef7c-5855-4d1f-8bd6-6586987a1887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:30.409095 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-c79bef7c-5855-4d1f-8bd6-6586987a1887 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:30.410286 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-c79bef7c-5855-4d1f-8bd6-6586987a1887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:30.418190 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 538/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:43:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:43:30.456811 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa09226-8663-4be4-ab9c-a287aa043ddd None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:30.471460 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa09226-8663-4be4-ab9c-a287aa043ddd None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:30.475484 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7bca53-4e2b-4097-9a09-c4b9fd5209d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:30.476119 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bca53-4e2b-4097-9a09-c4b9fd5209d1 service neutron] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:30.476400 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bca53-4e2b-4097-9a09-c4b9fd5209d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:30.476675 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7bca53-4e2b-4097-9a09-c4b9fd5209d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:30.486099 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7bca53-4e2b-4097-9a09-c4b9fd5209d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:30.487584 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7bca53-4e2b-4097-9a09-c4b9fd5209d1 service neutron] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:30.496928 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 543/1081] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:43:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:43:32.780697 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d75fb2-f783-410d-8228-72ea8d4f584f None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:32.781249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d75fb2-f783-410d-8228-72ea8d4f584f None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:32.781249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d75fb2-f783-410d-8228-72ea8d4f584f None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:32.782645 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 539/1082] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:32.788272 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca2fc2-1601-4337-8d7d-d5e6e4565125 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:32.788713 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca2fc2-1601-4337-8d7d-d5e6e4565125 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:32.788813 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca2fc2-1601-4337-8d7d-d5e6e4565125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:32.809389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-6dca2fc2-1601-4337-8d7d-d5e6e4565125 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:32.810601 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-6dca2fc2-1601-4337-8d7d-d5e6e4565125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:32.820171 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 544/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:43:32 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:43:32.860300 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d75fb2-f783-410d-8228-72ea8d4f584f None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:32.873223 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d75fb2-f783-410d-8228-72ea8d4f584f None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:32.879361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd13a26-ec56-430b-9e74-048debe78442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:32.880755 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd13a26-ec56-430b-9e74-048debe78442 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:32.881330 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd13a26-ec56-430b-9e74-048debe78442 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:32.881752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd13a26-ec56-430b-9e74-048debe78442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:32.897178 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd13a26-ec56-430b-9e74-048debe78442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:32.898939 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd13a26-ec56-430b-9e74-048debe78442 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:32.914101 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 540/1084] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:43:32 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:43:35.257658 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2074d31-f448-4eb9-9056-f15a090ec67a None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:35.258573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2074d31-f448-4eb9-9056-f15a090ec67a None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:35.258573 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2074d31-f448-4eb9-9056-f15a090ec67a None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:35.260841 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 545/1085] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:43:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:43:35.266036 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bdf880-4d70-42e9-b2e6-5631a752aeef None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:35.266457 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bdf880-4d70-42e9-b2e6-5631a752aeef None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:35.266547 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bdf880-4d70-42e9-b2e6-5631a752aeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:35.285580 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-84bdf880-4d70-42e9-b2e6-5631a752aeef None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:43:35.286813 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-84bdf880-4d70-42e9-b2e6-5631a752aeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:43:35.296713 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 541/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:43:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:43:35.334502 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2074d31-f448-4eb9-9056-f15a090ec67a None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:43:35.353066 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2074d31-f448-4eb9-9056-f15a090ec67a None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:43:35.357738 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb81670-5540-434a-9b0b-5b4f2e3c5ac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:43:35.358380 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb81670-5540-434a-9b0b-5b4f2e3c5ac6 service neutron] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:43:35.358662 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb81670-5540-434a-9b0b-5b4f2e3c5ac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:43:35.358990 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb81670-5540-434a-9b0b-5b4f2e3c5ac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:43:35.369756 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb81670-5540-434a-9b0b-5b4f2e3c5ac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:43:35.371373 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb81670-5540-434a-9b0b-5b4f2e3c5ac6 service neutron] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:43:35.381505 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 546/1087] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:43:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:43:45.279426 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=17 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:43:45.376862 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=17 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:11.892973 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db5b59-de52-4ae5-af0b-3c43c3e62201 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:11.893593 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db5b59-de52-4ae5-af0b-3c43c3e62201 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:11.893593 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4db5b59-de52-4ae5-af0b-3c43c3e62201 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:11.894935 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 542/1088] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:11.901303 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f48d05-7388-4d42-baf6-7150405d2482 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:11.901773 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f48d05-7388-4d42-baf6-7150405d2482 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:11.901873 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f48d05-7388-4d42-baf6-7150405d2482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:11.921477 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-09f48d05-7388-4d42-baf6-7150405d2482 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:11.922666 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-09f48d05-7388-4d42-baf6-7150405d2482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:11.931159 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 547/1089] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:44:11.990540 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41348369-1ccb-40cb-b713-912dfccf9609 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:11.990825 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41348369-1ccb-40cb-b713-912dfccf9609 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:11.991134 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41348369-1ccb-40cb-b713-912dfccf9609 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:11.992525 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 543/1090] 10.222.0.57 () {54 vars in 962 bytes} [Sat Jul 2 20:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:11.998522 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2c65a-71c5-4c04-87e1-03ece284859c None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:11.998831 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2c65a-71c5-4c04-87e1-03ece284859c None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:11.999131 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e2c65a-71c5-4c04-87e1-03ece284859c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:12.018703 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-18e2c65a-71c5-4c04-87e1-03ece284859c None None] MFA Rules not processed for user `bb3685e7474a40b0ba9115283446d430`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:12.019927 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-18e2c65a-71c5-4c04-87e1-03ece284859c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:12.028578 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 548/1091] 10.222.0.57 () {58 vars in 1059 bytes} [Sat Jul 2 20:44:11 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:44:12.036389 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41348369-1ccb-40cb-b713-912dfccf9609 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:12.050006 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41348369-1ccb-40cb-b713-912dfccf9609 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:12.054526 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abfef6-10c2-4f10-91f1-d25e1492f25f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3685e7474a40b0ba9115283446d430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:12.055209 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abfef6-10c2-4f10-91f1-d25e1492f25f service glance] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:12.055497 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abfef6-10c2-4f10-91f1-d25e1492f25f service glance] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:12.055773 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abfef6-10c2-4f10-91f1-d25e1492f25f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:12.065624 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abfef6-10c2-4f10-91f1-d25e1492f25f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:12.067133 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abfef6-10c2-4f10-91f1-d25e1492f25f service glance] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:12.077648 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 544/1092] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:44:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:44:14.445971 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f815ba-a106-4c71-849a-2e05a991a545 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:14.446566 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f815ba-a106-4c71-849a-2e05a991a545 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:14.446566 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f815ba-a106-4c71-849a-2e05a991a545 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:14.448229 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 549/1093] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:44:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:14.455079 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd517197-56c8-4a34-b0fc-f40c94a5b175 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:14.455492 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd517197-56c8-4a34-b0fc-f40c94a5b175 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:14.455717 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd517197-56c8-4a34-b0fc-f40c94a5b175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:14.483818 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-fd517197-56c8-4a34-b0fc-f40c94a5b175 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:14.485084 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-fd517197-56c8-4a34-b0fc-f40c94a5b175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:14.499247 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 545/1094] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:44:14.527554 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f815ba-a106-4c71-849a-2e05a991a545 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:14.542411 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f815ba-a106-4c71-849a-2e05a991a545 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:14.547905 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490156a3-5f31-421f-ac71-fdb79a6da3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:14.548552 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490156a3-5f31-421f-ac71-fdb79a6da3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:14.548823 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490156a3-5f31-421f-ac71-fdb79a6da3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:14.549094 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490156a3-5f31-421f-ac71-fdb79a6da3c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:14.549815 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490156a3-5f31-421f-ac71-fdb79a6da3c2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:14.551637 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: WARNING py.warnings [None req-490156a3-5f31-421f-ac71-fdb79a6da3c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:44:14.551637 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: warnings.warn(msg) Jul 02 20:44:14.551637 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: Jul 02 20:44:14.552777 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490156a3-5f31-421f-ac71-fdb79a6da3c2 admin admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:14.571949 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 550/1095] 10.222.0.57 () {56 vars in 1108 bytes} [Sat Jul 2 20:44:14 2022] GET /identity/v3/projects => generated 1606 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 20:44:16.843544 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d6ec5-2d98-4442-92fd-804cf812b89d None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:16.844326 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d6ec5-2d98-4442-92fd-804cf812b89d None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:16.844494 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d6ec5-2d98-4442-92fd-804cf812b89d None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:16.846819 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 546/1096] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:44:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:16.855177 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b2541-380e-4811-b2b9-ad3e94fad43b None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:16.855605 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b2541-380e-4811-b2b9-ad3e94fad43b None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:16.855732 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44b2541-380e-4811-b2b9-ad3e94fad43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:16.874555 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-d44b2541-380e-4811-b2b9-ad3e94fad43b None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:16.875801 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-d44b2541-380e-4811-b2b9-ad3e94fad43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:16.884263 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 551/1097] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:44:16.940270 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d6ec5-2d98-4442-92fd-804cf812b89d None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:16.956235 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d6ec5-2d98-4442-92fd-804cf812b89d None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:16.961757 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591ef87-f760-4068-aa5f-5f044caa0198 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:16.962398 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591ef87-f760-4068-aa5f-5f044caa0198 service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:16.962725 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591ef87-f760-4068-aa5f-5f044caa0198 service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:16.963048 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591ef87-f760-4068-aa5f-5f044caa0198 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:16.971361 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591ef87-f760-4068-aa5f-5f044caa0198 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:16.972934 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591ef87-f760-4068-aa5f-5f044caa0198 service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:16.982766 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 547/1098] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:44:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:44:19.413893 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a612032-2f53-4f82-965c-1551183a1bb6 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:19.414479 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a612032-2f53-4f82-965c-1551183a1bb6 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:19.414479 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a612032-2f53-4f82-965c-1551183a1bb6 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:19.415883 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 552/1099] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:19.421436 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ff008-de90-4e55-8cb8-06f70c235c97 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:19.421875 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ff008-de90-4e55-8cb8-06f70c235c97 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:19.421975 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ff008-de90-4e55-8cb8-06f70c235c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:19.440553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-fe7ff008-de90-4e55-8cb8-06f70c235c97 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:19.441738 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-fe7ff008-de90-4e55-8cb8-06f70c235c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:19.450405 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 548/1100] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:44:19.490484 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a612032-2f53-4f82-965c-1551183a1bb6 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:19.503204 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a612032-2f53-4f82-965c-1551183a1bb6 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:19.507484 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c59f3-a7f5-4e0b-9282-741807559ba6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:19.508117 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c59f3-a7f5-4e0b-9282-741807559ba6 service neutron] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:19.508389 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c59f3-a7f5-4e0b-9282-741807559ba6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:19.508655 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c59f3-a7f5-4e0b-9282-741807559ba6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:19.518302 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c59f3-a7f5-4e0b-9282-741807559ba6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:19.519751 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c59f3-a7f5-4e0b-9282-741807559ba6 service neutron] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:19.529262 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 553/1101] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:44:19 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:44:21.831778 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32d08e-d74d-4965-a959-e329c45ac9f0 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:21.832401 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32d08e-d74d-4965-a959-e329c45ac9f0 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:21.832401 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32d08e-d74d-4965-a959-e329c45ac9f0 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:21.833710 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 549/1102] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:21.839211 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc4c50-eef4-4685-901a-f8d90d835619 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:21.839656 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc4c50-eef4-4685-901a-f8d90d835619 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:21.839759 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc4c50-eef4-4685-901a-f8d90d835619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:21.858506 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-f7cc4c50-eef4-4685-901a-f8d90d835619 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:21.859800 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-f7cc4c50-eef4-4685-901a-f8d90d835619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:21.868876 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 554/1103] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:44:21.912966 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32d08e-d74d-4965-a959-e329c45ac9f0 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:21.925770 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32d08e-d74d-4965-a959-e329c45ac9f0 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:21.930157 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ede4e90-b4f2-42af-9815-a9751e25a929 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:21.930806 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede4e90-b4f2-42af-9815-a9751e25a929 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:21.931123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede4e90-b4f2-42af-9815-a9751e25a929 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:21.931439 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ede4e90-b4f2-42af-9815-a9751e25a929 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:21.941232 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede4e90-b4f2-42af-9815-a9751e25a929 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:21.942678 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ede4e90-b4f2-42af-9815-a9751e25a929 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:21.953046 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 550/1104] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:44:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:44:24.390470 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61f157-0ff3-4b54-b24f-4e275a6d931a None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:24.391064 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61f157-0ff3-4b54-b24f-4e275a6d931a None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:24.391064 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e61f157-0ff3-4b54-b24f-4e275a6d931a None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:24.392460 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 555/1105] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:24.398813 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aee11b-4900-4518-98a9-7e734f6f2dd4 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:24.399384 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aee11b-4900-4518-98a9-7e734f6f2dd4 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:24.399497 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aee11b-4900-4518-98a9-7e734f6f2dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:24.419424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-43aee11b-4900-4518-98a9-7e734f6f2dd4 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:24.420605 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-43aee11b-4900-4518-98a9-7e734f6f2dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:24.429335 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 551/1106] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:24 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:44:24.473749 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61f157-0ff3-4b54-b24f-4e275a6d931a None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:24.493481 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e61f157-0ff3-4b54-b24f-4e275a6d931a None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:24.498709 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0079479a-fc0c-48b2-ab30-1e25a7e87c82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:24.499417 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079479a-fc0c-48b2-ab30-1e25a7e87c82 service neutron] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:24.499698 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079479a-fc0c-48b2-ab30-1e25a7e87c82 service neutron] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:24.499967 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0079479a-fc0c-48b2-ab30-1e25a7e87c82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:24.510018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079479a-fc0c-48b2-ab30-1e25a7e87c82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:24.511492 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0079479a-fc0c-48b2-ab30-1e25a7e87c82 service neutron] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:24.521261 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 556/1107] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:44:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:44:27.033857 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66dc14-0cb7-40fd-b532-5336e6369980 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:27.034402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66dc14-0cb7-40fd-b532-5336e6369980 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:27.034402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d66dc14-0cb7-40fd-b532-5336e6369980 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:27.035714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 552/1108] 10.222.0.57 () {54 vars in 926 bytes} [Sat Jul 2 20:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:44:27.042329 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfe9eb-1c9a-49b4-b0b8-d07ce0ad770b None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:27.042767 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfe9eb-1c9a-49b4-b0b8-d07ce0ad770b None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:27.043160 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcfe9eb-1c9a-49b4-b0b8-d07ce0ad770b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:27.073507 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-1dcfe9eb-1c9a-49b4-b0b8-d07ce0ad770b None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:44:27.074702 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-1dcfe9eb-1c9a-49b4-b0b8-d07ce0ad770b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:44:27.084763 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 557/1109] 10.222.0.57 () {58 vars in 1023 bytes} [Sat Jul 2 20:44:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:44:27.130960 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66dc14-0cb7-40fd-b532-5336e6369980 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:44:27.143110 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d66dc14-0cb7-40fd-b532-5336e6369980 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:44:27.147248 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8213b6-6991-440a-851c-8411c64204b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:44:27.148131 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8213b6-6991-440a-851c-8411c64204b5 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:44:27.148407 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8213b6-6991-440a-851c-8411c64204b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:44:27.148677 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8213b6-6991-440a-851c-8411c64204b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:44:27.159047 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8213b6-6991-440a-851c-8411c64204b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:44:27.160492 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8213b6-6991-440a-851c-8411c64204b5 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:44:27.170227 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 553/1110] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:44:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:44:37.065242 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=33 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:44:37.165775 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=33 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:02.504673 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2aefb-ce62-49cd-9f7e-b2d0981c744d None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:02.505309 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2aefb-ce62-49cd-9f7e-b2d0981c744d None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:02.505309 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf2aefb-ce62-49cd-9f7e-b2d0981c744d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:02.526663 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-0cf2aefb-ce62-49cd-9f7e-b2d0981c744d None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:46:02.527895 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-0cf2aefb-ce62-49cd-9f7e-b2d0981c744d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:46:02.537082 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 558/1111] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jul 2 20:46:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:46:02.545076 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6c3fd-7424-44c8-8863-c0b5fe96d099 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:02.545616 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6c3fd-7424-44c8-8863-c0b5fe96d099 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:02.545616 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6c3fd-7424-44c8-8863-c0b5fe96d099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:02.563808 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-dae6c3fd-7424-44c8-8863-c0b5fe96d099 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:46:02.564973 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-dae6c3fd-7424-44c8-8863-c0b5fe96d099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:46:02.573521 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 554/1112] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jul 2 20:46:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:46:02.578434 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2aefb-ce62-49cd-9f7e-b2d0981c744d None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:02.592089 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf2aefb-ce62-49cd-9f7e-b2d0981c744d None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:02.597933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be3ce1-fcac-44f3-8bf1-4e78970f97c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:02.598604 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be3ce1-fcac-44f3-8bf1-4e78970f97c5 admin admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:02.598882 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be3ce1-fcac-44f3-8bf1-4e78970f97c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:02.599184 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2be3ce1-fcac-44f3-8bf1-4e78970f97c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:02.599924 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be3ce1-fcac-44f3-8bf1-4e78970f97c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:46:02.600228 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be3ce1-fcac-44f3-8bf1-4e78970f97c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:02.601486 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: WARNING py.warnings [None req-d2be3ce1-fcac-44f3-8bf1-4e78970f97c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:46:02.601486 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: warnings.warn(msg) Jul 02 20:46:02.601486 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: Jul 02 20:46:02.602368 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2be3ce1-fcac-44f3-8bf1-4e78970f97c5 admin admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:02.614178 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 559/1113] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jul 2 20:46:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:46:02.623168 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6c3fd-7424-44c8-8863-c0b5fe96d099 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:02.637222 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6c3fd-7424-44c8-8863-c0b5fe96d099 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:02.644553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba911e-f787-42ce-ba17-32810f937b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:02.645524 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba911e-f787-42ce-ba17-32810f937b50 admin admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:02.645865 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba911e-f787-42ce-ba17-32810f937b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:02.646200 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba911e-f787-42ce-ba17-32810f937b50 admin admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:02.647328 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba911e-f787-42ce-ba17-32810f937b50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:02.649355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: WARNING py.warnings [None req-3dba911e-f787-42ce-ba17-32810f937b50 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:46:02.649355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: warnings.warn(msg) Jul 02 20:46:02.649355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: Jul 02 20:46:02.650559 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba911e-f787-42ce-ba17-32810f937b50 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:02.679100 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 555/1114] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jul 2 20:46:02 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:46:02.683483 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be3ce1-fcac-44f3-8bf1-4e78970f97c5 admin admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:02.693483 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2be3ce1-fcac-44f3-8bf1-4e78970f97c5 admin admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:02.756849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a5290-db2b-465e-9883-d295149aa156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:02.759013 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a5290-db2b-465e-9883-d295149aa156 admin admin] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:02.759297 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a5290-db2b-465e-9883-d295149aa156 admin admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:02.759582 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30a5290-db2b-465e-9883-d295149aa156 admin admin] PATH_INFO: `/v3/users` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:02.760274 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a5290-db2b-465e-9883-d295149aa156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:02.761306 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: WARNING py.warnings [None req-a30a5290-db2b-465e-9883-d295149aa156 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:46:02.761306 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: warnings.warn(msg) Jul 02 20:46:02.761306 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: Jul 02 20:46:02.762531 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30a5290-db2b-465e-9883-d295149aa156 admin admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:02.784948 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 560/1115] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jul 2 20:46:02 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:46:02.789213 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba911e-f787-42ce-ba17-32810f937b50 admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:02.799994 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba911e-f787-42ce-ba17-32810f937b50 admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:02.805991 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a9340-8101-4ca6-8f84-fea99b92fc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:02.806662 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a9340-8101-4ca6-8f84-fea99b92fc82 admin admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:02.806938 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a9340-8101-4ca6-8f84-fea99b92fc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:02.807250 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a9340-8101-4ca6-8f84-fea99b92fc82 admin admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:02.807942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a9340-8101-4ca6-8f84-fea99b92fc82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:02.808974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: WARNING py.warnings [None req-8f6a9340-8101-4ca6-8f84-fea99b92fc82 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:46:02.808974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: warnings.warn(msg) Jul 02 20:46:02.808974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: Jul 02 20:46:02.809859 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6a9340-8101-4ca6-8f84-fea99b92fc82 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:02.823553 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 556/1116] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jul 2 20:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 20:46:02.828145 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a5290-db2b-465e-9883-d295149aa156 admin admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:02.840965 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30a5290-db2b-465e-9883-d295149aa156 admin admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:02.847474 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d8d17-1422-460a-a919-5e8afd0d4751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:02.848152 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d8d17-1422-460a-a919-5e8afd0d4751 admin admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:02.848446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d8d17-1422-460a-a919-5e8afd0d4751 admin admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:02.848692 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d8d17-1422-460a-a919-5e8afd0d4751 admin admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:02.849427 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d8d17-1422-460a-a919-5e8afd0d4751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:02.850494 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: WARNING py.warnings [None req-c36d8d17-1422-460a-a919-5e8afd0d4751 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:46:02.850494 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: warnings.warn(msg) Jul 02 20:46:02.850494 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: Jul 02 20:46:02.851727 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d8d17-1422-460a-a919-5e8afd0d4751 admin admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:02.870162 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 561/1117] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jul 2 20:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 20:46:02.875014 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a9340-8101-4ca6-8f84-fea99b92fc82 admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:02.889915 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6a9340-8101-4ca6-8f84-fea99b92fc82 admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:02.896643 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbf53c-9a11-476b-8dd3-1cbef15e8e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:02.897545 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbf53c-9a11-476b-8dd3-1cbef15e8e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:02.898028 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbf53c-9a11-476b-8dd3-1cbef15e8e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:02.898248 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbf53c-9a11-476b-8dd3-1cbef15e8e81 admin admin] PATH_INFO: `/v3/projects/5bb3b9c1c0ab4a229b10febb5569d642/users/7ef65f569d184dc98d3351e0fb8477bc/roles/538580824ccd4e02823540ee3df31cdc` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:02.914803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbf53c-9a11-476b-8dd3-1cbef15e8e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bb3b9c1c0ab4a229b10febb5569d642, user_id=7ef65f569d184dc98d3351e0fb8477bc, role_id=538580824ccd4e02823540ee3df31cdc)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:02.915900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: WARNING py.warnings [None req-edbbf53c-9a11-476b-8dd3-1cbef15e8e81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:46:02.915900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: warnings.warn(msg) Jul 02 20:46:02.915900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: Jul 02 20:46:02.917829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbf53c-9a11-476b-8dd3-1cbef15e8e81 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:02.934164 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 557/1118] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jul 2 20:46:02 2022] PUT /identity/v3/projects/5bb3b9c1c0ab4a229b10febb5569d642/users/7ef65f569d184dc98d3351e0fb8477bc/roles/538580824ccd4e02823540ee3df31cdc => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:46:02.947332 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861723f4-5ff7-4b1a-a4ef-fb29c353ce6b None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:02.947636 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861723f4-5ff7-4b1a-a4ef-fb29c353ce6b None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:02.948002 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861723f4-5ff7-4b1a-a4ef-fb29c353ce6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:02.978213 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-861723f4-5ff7-4b1a-a4ef-fb29c353ce6b None None] MFA Rules not processed for user `7ef65f569d184dc98d3351e0fb8477bc`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:46:02.979447 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-861723f4-5ff7-4b1a-a4ef-fb29c353ce6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:46:03.047125 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 562/1119] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jul 2 20:46:02 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:46:03.065557 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696d4db-902f-4bf6-9de4-de09f243bad9 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:03.065845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696d4db-902f-4bf6-9de4-de09f243bad9 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:03.066119 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696d4db-902f-4bf6-9de4-de09f243bad9 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:03.067546 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 558/1120] 10.222.0.57 () {54 vars in 963 bytes} [Sat Jul 2 20:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:46:03.073570 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0608b-c918-4f57-be11-9ebb5bd8a091 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:03.073857 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0608b-c918-4f57-be11-9ebb5bd8a091 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:03.074127 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0608b-c918-4f57-be11-9ebb5bd8a091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:03.101189 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-73d0608b-c918-4f57-be11-9ebb5bd8a091 None None] MFA Rules not processed for user `875c7134ed804201831348457be9d247`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:46:03.102936 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-73d0608b-c918-4f57-be11-9ebb5bd8a091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:46:03.156939 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:03.167502 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 563/1121] 10.222.0.57 () {58 vars in 1060 bytes} [Sat Jul 2 20:46:03 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:46:03.177205 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696d4db-902f-4bf6-9de4-de09f243bad9 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:03.189568 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696d4db-902f-4bf6-9de4-de09f243bad9 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:03.193621 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e98a5e-27d5-4743-a4f4-6d809f9d905d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '875c7134ed804201831348457be9d247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:03.194263 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e98a5e-27d5-4743-a4f4-6d809f9d905d service cinder] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:03.194551 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e98a5e-27d5-4743-a4f4-6d809f9d905d service cinder] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:03.194874 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e98a5e-27d5-4743-a4f4-6d809f9d905d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:03.204211 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e98a5e-27d5-4743-a4f4-6d809f9d905d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:03.205650 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e98a5e-27d5-4743-a4f4-6d809f9d905d service cinder] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:03.214953 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 559/1122] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:46:03 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:46:03.258076 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f394991-f1d4-4d39-8523-b456c1c82432 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:03.258383 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f394991-f1d4-4d39-8523-b456c1c82432 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:03.258655 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f394991-f1d4-4d39-8523-b456c1c82432 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:03.260566 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 564/1123] 10.222.0.57 () {52 vars in 829 bytes} [Sat Jul 2 20:46:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:46:03.264737 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e98a5e-27d5-4743-a4f4-6d809f9d905d service cinder] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:03.340646 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e98a5e-27d5-4743-a4f4-6d809f9d905d service cinder] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:03.345379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4461418-80aa-4f3a-9bcc-06b2fe542e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:03.346277 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4461418-80aa-4f3a-9bcc-06b2fe542e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:03.346550 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4461418-80aa-4f3a-9bcc-06b2fe542e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:03.346819 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4461418-80aa-4f3a-9bcc-06b2fe542e22 admin admin] PATH_INFO: `/v3/users/7ef65f569d184dc98d3351e0fb8477bc` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:03.348064 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4461418-80aa-4f3a-9bcc-06b2fe542e22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ef65f569d184dc98d3351e0fb8477bc)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:03.349090 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: WARNING py.warnings [None req-d4461418-80aa-4f3a-9bcc-06b2fe542e22 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:46:03.349090 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: warnings.warn(msg) Jul 02 20:46:03.349090 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: Jul 02 20:46:03.350297 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4461418-80aa-4f3a-9bcc-06b2fe542e22 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:03.420415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-d4461418-80aa-4f3a-9bcc-06b2fe542e22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ef65f569d184dc98d3351e0fb8477bc'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:46:03.433461 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-d4461418-80aa-4f3a-9bcc-06b2fe542e22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ef65f569d184dc98d3351e0fb8477bc'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:46:03.446294 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-d4461418-80aa-4f3a-9bcc-06b2fe542e22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ef65f569d184dc98d3351e0fb8477bc'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:46:03.447096 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-d4461418-80aa-4f3a-9bcc-06b2fe542e22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ef65f569d184dc98d3351e0fb8477bc'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:46:03.447918 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-d4461418-80aa-4f3a-9bcc-06b2fe542e22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ef65f569d184dc98d3351e0fb8477bc'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:46:03.474025 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 560/1124] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jul 2 20:46:03 2022] DELETE /identity/v3/users/7ef65f569d184dc98d3351e0fb8477bc => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:46:03.478656 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ffa02-67c8-4633-b26d-6cd7980c618e None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:03.478959 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ffa02-67c8-4633-b26d-6cd7980c618e None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:03.479233 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ffa02-67c8-4633-b26d-6cd7980c618e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:03.496906 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-906ffa02-67c8-4633-b26d-6cd7980c618e None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:46:03.498083 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-906ffa02-67c8-4633-b26d-6cd7980c618e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:46:03.558950 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 565/1125] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jul 2 20:46:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:46:03.568734 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4461418-80aa-4f3a-9bcc-06b2fe542e22 admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:03.570249 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-d4461418-80aa-4f3a-9bcc-06b2fe542e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:46:03.576192 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:03.638077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4461418-80aa-4f3a-9bcc-06b2fe542e22 admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:03.642171 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58642d03-f62d-4612-a6e3-7047f10ab153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:03.642820 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58642d03-f62d-4612-a6e3-7047f10ab153 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:03.643135 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58642d03-f62d-4612-a6e3-7047f10ab153 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:03.643411 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58642d03-f62d-4612-a6e3-7047f10ab153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:03.653055 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58642d03-f62d-4612-a6e3-7047f10ab153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:03.654495 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58642d03-f62d-4612-a6e3-7047f10ab153 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:03.664354 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 561/1126] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:46:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:46:04.043481 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ffa02-67c8-4633-b26d-6cd7980c618e None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:46:04.044987 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-906ffa02-67c8-4633-b26d-6cd7980c618e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:46:04.058729 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ffa02-67c8-4633-b26d-6cd7980c618e None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:46:04.064486 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d45e56-751f-4edc-9542-e17da86cea8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:46:04.065328 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d45e56-751f-4edc-9542-e17da86cea8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:46:04.065682 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d45e56-751f-4edc-9542-e17da86cea8f admin admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:46:04.066012 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d45e56-751f-4edc-9542-e17da86cea8f admin admin] PATH_INFO: `/v3/projects/5bb3b9c1c0ab4a229b10febb5569d642` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:46:04.067446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d45e56-751f-4edc-9542-e17da86cea8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bb3b9c1c0ab4a229b10febb5569d642)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:46:04.068554 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: WARNING py.warnings [None req-a1d45e56-751f-4edc-9542-e17da86cea8f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:46:04.068554 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: warnings.warn(msg) Jul 02 20:46:04.068554 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: Jul 02 20:46:04.070045 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d45e56-751f-4edc-9542-e17da86cea8f admin admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:46:04.134051 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-a1d45e56-751f-4edc-9542-e17da86cea8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bb3b9c1c0ab4a229b10febb5569d642', 'request_id': 'req-a1d45e56-751f-4edc-9542-e17da86cea8f'} {{(pid=98934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:46:04.144501 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-a1d45e56-751f-4edc-9542-e17da86cea8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bb3b9c1c0ab4a229b10febb5569d642', 'request_id': 'req-a1d45e56-751f-4edc-9542-e17da86cea8f'} {{(pid=98934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:46:04.150888 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-a1d45e56-751f-4edc-9542-e17da86cea8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bb3b9c1c0ab4a229b10febb5569d642', 'request_id': 'req-a1d45e56-751f-4edc-9542-e17da86cea8f'} {{(pid=98934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:46:04.170489 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-a1d45e56-751f-4edc-9542-e17da86cea8f admin admin] The token cache is being invalidate because project 5bb3b9c1c0ab4a229b10febb5569d642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 20:46:04.170781 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-a1d45e56-751f-4edc-9542-e17da86cea8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:46:04.171670 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-a1d45e56-751f-4edc-9542-e17da86cea8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:46:04.173412 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 566/1127] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jul 2 20:46:04 2022] DELETE /identity/v3/projects/5bb3b9c1c0ab4a229b10febb5569d642 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:46:13.660014 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=25 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:46:14.167273 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:47:26.874724 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf82fb-fe6d-417e-a48f-212fcc911064 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:26.875379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf82fb-fe6d-417e-a48f-212fcc911064 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:26.875379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf82fb-fe6d-417e-a48f-212fcc911064 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:26.876691 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 562/1128] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 20:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:47:26.882464 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921a444-d590-4fa8-ae7d-74fbd200afe9 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:26.883620 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921a444-d590-4fa8-ae7d-74fbd200afe9 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:26.883620 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921a444-d590-4fa8-ae7d-74fbd200afe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:26.954390 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-8921a444-d590-4fa8-ae7d-74fbd200afe9 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:47:26.955924 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-8921a444-d590-4fa8-ae7d-74fbd200afe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:47:27.054686 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 567/1129] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 20:47:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:47:27.213828 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf82fb-fe6d-417e-a48f-212fcc911064 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:47:27.215968 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-86cf82fb-fe6d-417e-a48f-212fcc911064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:47:27.314746 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf82fb-fe6d-417e-a48f-212fcc911064 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:47:27.321063 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d17da5-59bd-4cae-b2ab-d23493e66f7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:47:27.321717 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d17da5-59bd-4cae-b2ab-d23493e66f7e service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:27.321997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d17da5-59bd-4cae-b2ab-d23493e66f7e service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:27.322269 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d17da5-59bd-4cae-b2ab-d23493e66f7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:27.331751 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d17da5-59bd-4cae-b2ab-d23493e66f7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:47:27.333365 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d17da5-59bd-4cae-b2ab-d23493e66f7e service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:47:27.343171 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 563/1130] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:47:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:47:28.171618 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74813066-b681-4aeb-b342-5c8c94c4daf3 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:28.172241 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74813066-b681-4aeb-b342-5c8c94c4daf3 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:28.172241 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74813066-b681-4aeb-b342-5c8c94c4daf3 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:28.174142 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 568/1131] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 20:47:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:47:28.181498 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49125a-bdd5-4d72-922a-e55aac549493 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:28.181961 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49125a-bdd5-4d72-922a-e55aac549493 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:28.182057 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c49125a-bdd5-4d72-922a-e55aac549493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:28.201657 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-8c49125a-bdd5-4d72-922a-e55aac549493 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:47:28.203188 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-8c49125a-bdd5-4d72-922a-e55aac549493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:47:28.211780 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 564/1132] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 20:47:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 20:47:28.366977 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74813066-b681-4aeb-b342-5c8c94c4daf3 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:47:28.384375 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74813066-b681-4aeb-b342-5c8c94c4daf3 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:47:28.389870 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4138a-dcdf-462a-98ea-1280fec6c93e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:47:28.390506 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4138a-dcdf-462a-98ea-1280fec6c93e service nova] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:28.390782 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4138a-dcdf-462a-98ea-1280fec6c93e service nova] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:28.391080 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4138a-dcdf-462a-98ea-1280fec6c93e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:28.401124 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4138a-dcdf-462a-98ea-1280fec6c93e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:47:28.403837 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4138a-dcdf-462a-98ea-1280fec6c93e service nova] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:47:28.417791 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 569/1133] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:47:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:47:32.893890 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4ee08-63c4-4fb2-9753-df510b4ddcbb None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:32.894487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4ee08-63c4-4fb2-9753-df510b4ddcbb None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:32.894487 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4ee08-63c4-4fb2-9753-df510b4ddcbb None None] PATH_INFO: `/v3` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:32.896439 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 565/1134] 10.222.0.61 () {54 vars in 925 bytes} [Sat Jul 2 20:47:32 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:47:32.903184 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3193d53-0616-4a9b-99bb-30be944a2d6a None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:32.903641 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3193d53-0616-4a9b-99bb-30be944a2d6a None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:32.903745 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3193d53-0616-4a9b-99bb-30be944a2d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:32.937502 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-a3193d53-0616-4a9b-99bb-30be944a2d6a None None] MFA Rules not processed for user `f2377f751a584f678c0ddebc4de0ae44`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:47:32.938723 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-a3193d53-0616-4a9b-99bb-30be944a2d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:47:32.994464 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:47:33.005458 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 570/1135] 10.222.0.61 () {58 vars in 1015 bytes} [Sat Jul 2 20:47:32 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:47:38.197201 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=42 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:47:39.682659 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f4932-2946-4357-9f30-ba2bc904cbfe None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:39.683356 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f4932-2946-4357-9f30-ba2bc904cbfe None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:39.683356 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539f4932-2946-4357-9f30-ba2bc904cbfe None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:39.684629 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 566/1136] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 20:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:47:39.690528 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3692e-19f5-4f69-b9fb-2dc619cbd124 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:39.691336 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3692e-19f5-4f69-b9fb-2dc619cbd124 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:39.691487 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a3692e-19f5-4f69-b9fb-2dc619cbd124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:39.712572 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-72a3692e-19f5-4f69-b9fb-2dc619cbd124 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:47:39.713776 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-72a3692e-19f5-4f69-b9fb-2dc619cbd124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:47:39.723693 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 571/1137] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 20:47:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:47:39.888653 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f4932-2946-4357-9f30-ba2bc904cbfe None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:47:39.907169 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539f4932-2946-4357-9f30-ba2bc904cbfe None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:47:39.912560 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc60ac-e4d0-4212-a90e-2b691d628d1e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:47:39.913198 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc60ac-e4d0-4212-a90e-2b691d628d1e service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:39.913475 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc60ac-e4d0-4212-a90e-2b691d628d1e service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:39.913748 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc60ac-e4d0-4212-a90e-2b691d628d1e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:39.921986 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc60ac-e4d0-4212-a90e-2b691d628d1e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:47:39.923632 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc60ac-e4d0-4212-a90e-2b691d628d1e service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:47:39.933327 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 567/1138] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:47:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:47:40.750288 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2de48c-79b3-4b1e-80ce-d4ed6f1ee41f None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:40.750744 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2de48c-79b3-4b1e-80ce-d4ed6f1ee41f None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:40.750861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2de48c-79b3-4b1e-80ce-d4ed6f1ee41f None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:40.752911 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 572/1139] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 20:47:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:47:40.757866 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed333e8-7b3f-4fd3-b66a-cf4402d69084 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:40.758287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed333e8-7b3f-4fd3-b66a-cf4402d69084 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:40.758379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed333e8-7b3f-4fd3-b66a-cf4402d69084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:40.776938 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-5ed333e8-7b3f-4fd3-b66a-cf4402d69084 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:47:40.778123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-5ed333e8-7b3f-4fd3-b66a-cf4402d69084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:47:40.786521 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 568/1140] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 20:47:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:47:40.946775 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2de48c-79b3-4b1e-80ce-d4ed6f1ee41f None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:47:40.962823 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2de48c-79b3-4b1e-80ce-d4ed6f1ee41f None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:47:40.968544 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834da76b-3d03-4b88-b96d-2ae35bce30a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:47:40.969122 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834da76b-3d03-4b88-b96d-2ae35bce30a6 service nova] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:40.969400 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834da76b-3d03-4b88-b96d-2ae35bce30a6 service nova] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:40.969672 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834da76b-3d03-4b88-b96d-2ae35bce30a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:40.979134 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834da76b-3d03-4b88-b96d-2ae35bce30a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:47:40.980809 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834da76b-3d03-4b88-b96d-2ae35bce30a6 service nova] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:47:40.990632 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 573/1141] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:47:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:47:42.440404 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cfd45-5f47-487f-ac35-42e08f2303bd None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:42.441023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cfd45-5f47-487f-ac35-42e08f2303bd None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:42.441023 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cfd45-5f47-487f-ac35-42e08f2303bd None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:42.442350 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 569/1142] 10.222.0.57 () {54 vars in 960 bytes} [Sat Jul 2 20:47:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:47:42.448861 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dcf04-cec7-4ca0-8457-7a48bc96be37 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:42.449323 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dcf04-cec7-4ca0-8457-7a48bc96be37 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:42.449430 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83dcf04-cec7-4ca0-8457-7a48bc96be37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:42.479564 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-a83dcf04-cec7-4ca0-8457-7a48bc96be37 None None] MFA Rules not processed for user `f2377f751a584f678c0ddebc4de0ae44`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:47:42.480780 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-a83dcf04-cec7-4ca0-8457-7a48bc96be37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:47:42.490777 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 574/1143] 10.222.0.57 () {58 vars in 1057 bytes} [Sat Jul 2 20:47:42 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:47:42.499501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411cfd45-5f47-487f-ac35-42e08f2303bd None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:47:42.518277 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411cfd45-5f47-487f-ac35-42e08f2303bd None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:47:42.526267 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c45766-8b99-4aa7-9376-dd4dcc1b847a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2377f751a584f678c0ddebc4de0ae44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:47:42.526967 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c45766-8b99-4aa7-9376-dd4dcc1b847a service placement] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:42.527289 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c45766-8b99-4aa7-9376-dd4dcc1b847a service placement] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:42.527562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c45766-8b99-4aa7-9376-dd4dcc1b847a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:42.536680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c45766-8b99-4aa7-9376-dd4dcc1b847a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:47:42.538299 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c45766-8b99-4aa7-9376-dd4dcc1b847a service placement] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:47:42.548606 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 570/1144] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:47:42 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:47:52.325513 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16be8d7-1453-49b2-bc01-f775e3c2a5dd None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:52.326510 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16be8d7-1453-49b2-bc01-f775e3c2a5dd None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:52.326510 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16be8d7-1453-49b2-bc01-f775e3c2a5dd None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:52.328968 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 575/1145] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 20:47:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:47:52.337165 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0eaa5-7b49-460d-bfc2-dfe1ce3c32a4 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:52.337640 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0eaa5-7b49-460d-bfc2-dfe1ce3c32a4 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:52.337745 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf0eaa5-7b49-460d-bfc2-dfe1ce3c32a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:52.361959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-ddf0eaa5-7b49-460d-bfc2-dfe1ce3c32a4 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:47:52.363196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-ddf0eaa5-7b49-460d-bfc2-dfe1ce3c32a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:47:52.372671 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 571/1146] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 20:47:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:47:52.471394 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=12 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:47:52.535511 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16be8d7-1453-49b2-bc01-f775e3c2a5dd None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:47:52.558341 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16be8d7-1453-49b2-bc01-f775e3c2a5dd None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:47:52.563574 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec47403-64a6-49f2-994f-1f726bf2c86f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:47:52.564210 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec47403-64a6-49f2-994f-1f726bf2c86f service nova] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:52.564486 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec47403-64a6-49f2-994f-1f726bf2c86f service nova] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:52.564727 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec47403-64a6-49f2-994f-1f726bf2c86f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:52.573088 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec47403-64a6-49f2-994f-1f726bf2c86f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:47:52.574663 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec47403-64a6-49f2-994f-1f726bf2c86f service nova] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:47:52.584342 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 576/1147] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:47:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:47:53.393461 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a454e0d-f4a6-43b7-92dd-61289036c474 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:53.394013 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a454e0d-f4a6-43b7-92dd-61289036c474 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:53.394013 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a454e0d-f4a6-43b7-92dd-61289036c474 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:53.398849 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 572/1148] 127.0.0.1 () {54 vars in 901 bytes} [Sat Jul 2 20:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:47:53.400468 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711f1b4-8038-4179-bdab-a4fcb53e0cbc None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:53.400878 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711f1b4-8038-4179-bdab-a4fcb53e0cbc None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:53.400974 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2711f1b4-8038-4179-bdab-a4fcb53e0cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:53.420107 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-2711f1b4-8038-4179-bdab-a4fcb53e0cbc None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:47:53.421297 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-2711f1b4-8038-4179-bdab-a4fcb53e0cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:47:53.429883 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 577/1149] 127.0.0.1 () {58 vars in 998 bytes} [Sat Jul 2 20:47:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:47:53.587691 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a454e0d-f4a6-43b7-92dd-61289036c474 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:47:53.609240 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a454e0d-f4a6-43b7-92dd-61289036c474 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:47:53.615444 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e13b8-38b7-4d63-b6a2-27dbf27a4388 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:47:53.616119 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e13b8-38b7-4d63-b6a2-27dbf27a4388 service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:53.616397 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e13b8-38b7-4d63-b6a2-27dbf27a4388 service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:53.616693 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e13b8-38b7-4d63-b6a2-27dbf27a4388 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:53.625984 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e13b8-38b7-4d63-b6a2-27dbf27a4388 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:47:53.627674 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e13b8-38b7-4d63-b6a2-27dbf27a4388 service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:47:53.637830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 573/1150] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:47:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:47:57.706157 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ae8e7-266c-47c4-97fd-47be5cde5475 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:57.706831 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ae8e7-266c-47c4-97fd-47be5cde5475 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:57.706831 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ae8e7-266c-47c4-97fd-47be5cde5475 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:57.708124 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 578/1151] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:47:57.713769 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab322e75-9b07-410d-b262-d00775d5bbd7 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:57.714236 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab322e75-9b07-410d-b262-d00775d5bbd7 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:57.714466 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab322e75-9b07-410d-b262-d00775d5bbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:57.734035 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-ab322e75-9b07-410d-b262-d00775d5bbd7 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:47:57.735258 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-ab322e75-9b07-410d-b262-d00775d5bbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:47:57.743541 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 574/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:47:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:47:57.781145 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ae8e7-266c-47c4-97fd-47be5cde5475 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:47:57.784157 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-342ae8e7-266c-47c4-97fd-47be5cde5475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:47:57.861317 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ae8e7-266c-47c4-97fd-47be5cde5475 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:47:57.866218 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd31e5-29f1-40e2-a6ae-6d1cfa5904d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:47:57.866866 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd31e5-29f1-40e2-a6ae-6d1cfa5904d0 service neutron] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:47:57.867169 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd31e5-29f1-40e2-a6ae-6d1cfa5904d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:47:57.867438 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd31e5-29f1-40e2-a6ae-6d1cfa5904d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:47:57.877635 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd31e5-29f1-40e2-a6ae-6d1cfa5904d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:47:57.879141 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd31e5-29f1-40e2-a6ae-6d1cfa5904d0 service neutron] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:47:57.889039 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 579/1153] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:47:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:48:00.158178 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d008fe-39cf-43b8-b1d7-cdd10283ce20 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:00.158768 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d008fe-39cf-43b8-b1d7-cdd10283ce20 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:00.158768 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d008fe-39cf-43b8-b1d7-cdd10283ce20 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:00.160888 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 575/1154] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:48:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:48:00.169498 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050bbe5-0e30-4cd3-962a-8b3693ca1dab None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:00.169908 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050bbe5-0e30-4cd3-962a-8b3693ca1dab None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:00.170103 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050bbe5-0e30-4cd3-962a-8b3693ca1dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:00.195116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-c050bbe5-0e30-4cd3-962a-8b3693ca1dab None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:48:00.196319 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-c050bbe5-0e30-4cd3-962a-8b3693ca1dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:48:00.206041 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 580/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:48:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:48:00.243715 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d008fe-39cf-43b8-b1d7-cdd10283ce20 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:00.246368 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-31d008fe-39cf-43b8-b1d7-cdd10283ce20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:48:00.276320 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d008fe-39cf-43b8-b1d7-cdd10283ce20 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:00.280379 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c0008f-f62d-4332-b2cc-aa5bdc2d7d32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:00.281019 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0008f-f62d-4332-b2cc-aa5bdc2d7d32 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:00.281296 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0008f-f62d-4332-b2cc-aa5bdc2d7d32 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:00.281564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c0008f-f62d-4332-b2cc-aa5bdc2d7d32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:00.291268 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0008f-f62d-4332-b2cc-aa5bdc2d7d32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:00.292823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c0008f-f62d-4332-b2cc-aa5bdc2d7d32 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:00.302880 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 576/1156] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:48:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:48:04.113249 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdd0be-3d9a-4aa8-b634-aed63380ad31 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:04.114169 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdd0be-3d9a-4aa8-b634-aed63380ad31 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:04.114169 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cdd0be-3d9a-4aa8-b634-aed63380ad31 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:04.116321 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 581/1157] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:48:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:48:04.121925 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8cc04-d0ab-4a23-a32f-ac7e478802c7 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:04.122346 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8cc04-d0ab-4a23-a32f-ac7e478802c7 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:04.122468 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8cc04-d0ab-4a23-a32f-ac7e478802c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:04.143675 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-cfc8cc04-d0ab-4a23-a32f-ac7e478802c7 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:48:04.144877 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-cfc8cc04-d0ab-4a23-a32f-ac7e478802c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:48:04.153147 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 577/1158] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:48:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:48:04.424214 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdd0be-3d9a-4aa8-b634-aed63380ad31 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:04.427416 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-20cdd0be-3d9a-4aa8-b634-aed63380ad31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:48:04.505441 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cdd0be-3d9a-4aa8-b634-aed63380ad31 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:04.509869 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71fab5-006a-4e59-b429-e8c3abe76be6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '875c7134ed804201831348457be9d247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:04.510533 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71fab5-006a-4e59-b429-e8c3abe76be6 service cinder] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:04.510851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71fab5-006a-4e59-b429-e8c3abe76be6 service cinder] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:04.511218 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71fab5-006a-4e59-b429-e8c3abe76be6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:04.521205 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71fab5-006a-4e59-b429-e8c3abe76be6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:04.522635 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c71fab5-006a-4e59-b429-e8c3abe76be6 service cinder] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:04.532513 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 582/1159] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:48:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:48:06.828461 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f9239-05eb-4e3f-8dd4-7fa62781e3a3 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:06.829017 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f9239-05eb-4e3f-8dd4-7fa62781e3a3 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:06.829017 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f9239-05eb-4e3f-8dd4-7fa62781e3a3 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:06.830321 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 578/1160] 127.0.0.1 () {54 vars in 916 bytes} [Sat Jul 2 20:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:48:06.835868 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b06f6f-0601-43a6-85ba-02fe2bab81a8 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:06.836318 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b06f6f-0601-43a6-85ba-02fe2bab81a8 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:06.836420 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b06f6f-0601-43a6-85ba-02fe2bab81a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:06.856626 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-87b06f6f-0601-43a6-85ba-02fe2bab81a8 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:48:06.857814 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-87b06f6f-0601-43a6-85ba-02fe2bab81a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:48:06.867168 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 583/1161] 127.0.0.1 () {58 vars in 1013 bytes} [Sat Jul 2 20:48:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:48:07.137029 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f9239-05eb-4e3f-8dd4-7fa62781e3a3 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:48:07.139396 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-008f9239-05eb-4e3f-8dd4-7fa62781e3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:48:07.161680 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008f9239-05eb-4e3f-8dd4-7fa62781e3a3 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:48:07.168113 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9ce24-cc8b-4922-a29f-9f38b16f313e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '875c7134ed804201831348457be9d247', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:48:07.168874 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9ce24-cc8b-4922-a29f-9f38b16f313e service cinder] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:48:07.169154 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9ce24-cc8b-4922-a29f-9f38b16f313e service cinder] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:48:07.169421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9ce24-cc8b-4922-a29f-9f38b16f313e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:48:07.179846 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9ce24-cc8b-4922-a29f-9f38b16f313e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:48:07.181294 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9ce24-cc8b-4922-a29f-9f38b16f313e service cinder] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:48:07.192551 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 579/1162] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:48:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:48:16.851109 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=72 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:48:17.187632 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=47 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:49:26.173987 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323c448-846b-46f8-b693-0746f510bcba None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:26.174670 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323c448-846b-46f8-b693-0746f510bcba None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:26.174670 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3323c448-846b-46f8-b693-0746f510bcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:26.176191 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72caf9-41be-49c2-8eed-31a8ea975b66 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:26.176660 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72caf9-41be-49c2-8eed-31a8ea975b66 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:26.176748 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a72caf9-41be-49c2-8eed-31a8ea975b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:26.193530 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-3323c448-846b-46f8-b693-0746f510bcba None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:49:26.193786 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-2a72caf9-41be-49c2-8eed-31a8ea975b66 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:49:26.204498 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-2a72caf9-41be-49c2-8eed-31a8ea975b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:26.204696 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-3323c448-846b-46f8-b693-0746f510bcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:26.212672 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 580/1163] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jul 2 20:49:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:49:26.213182 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 584/1164] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jul 2 20:49:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:49:26.221066 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db072a7-c668-4523-9804-46f953e2250f None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:26.221248 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8cb7b-4a2f-4555-87c1-c745b2b992a7 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:26.221373 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db072a7-c668-4523-9804-46f953e2250f None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:26.221527 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8cb7b-4a2f-4555-87c1-c745b2b992a7 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:26.221637 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db072a7-c668-4523-9804-46f953e2250f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:26.221833 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8cb7b-4a2f-4555-87c1-c745b2b992a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:26.240185 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-0db072a7-c668-4523-9804-46f953e2250f None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:49:26.241008 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-9bb8cb7b-4a2f-4555-87c1-c745b2b992a7 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:49:26.241362 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-0db072a7-c668-4523-9804-46f953e2250f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:26.242196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-9bb8cb7b-4a2f-4555-87c1-c745b2b992a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:26.249610 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 581/1165] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jul 2 20:49:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:49:26.251143 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 585/1166] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jul 2 20:49:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:49:26.254285 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db072a7-c668-4523-9804-46f953e2250f None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:26.255480 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8cb7b-4a2f-4555-87c1-c745b2b992a7 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:26.264138 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db072a7-c668-4523-9804-46f953e2250f None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:26.265207 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8cb7b-4a2f-4555-87c1-c745b2b992a7 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:26.269154 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357e9ef-00d2-40c9-9efe-bb64bd04bc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:26.269835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357e9ef-00d2-40c9-9efe-bb64bd04bc87 admin admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:26.270104 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357e9ef-00d2-40c9-9efe-bb64bd04bc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:26.270376 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0357e9ef-00d2-40c9-9efe-bb64bd04bc87 admin admin] PATH_INFO: `/v3/domains` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:26.271097 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fad5c-722f-4a9c-988c-1ee240cdc76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:26.271274 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357e9ef-00d2-40c9-9efe-bb64bd04bc87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98933) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:49:26.271509 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357e9ef-00d2-40c9-9efe-bb64bd04bc87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:26.271738 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fad5c-722f-4a9c-988c-1ee240cdc76d admin admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:26.272011 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fad5c-722f-4a9c-988c-1ee240cdc76d admin admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:26.272399 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fad5c-722f-4a9c-988c-1ee240cdc76d admin admin] PATH_INFO: `/v3/domains` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:26.272506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: WARNING py.warnings [None req-0357e9ef-00d2-40c9-9efe-bb64bd04bc87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:49:26.272506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: warnings.warn(msg) Jul 02 20:49:26.272506 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: Jul 02 20:49:26.273385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0357e9ef-00d2-40c9-9efe-bb64bd04bc87 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:26.273497 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5fad5c-722f-4a9c-988c-1ee240cdc76d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=98934) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 02 20:49:26.273709 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5fad5c-722f-4a9c-988c-1ee240cdc76d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:26.275437 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5fad5c-722f-4a9c-988c-1ee240cdc76d admin admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:26.285174 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 582/1167] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jul 2 20:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:49:26.288996 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 586/1168] 10.222.0.57 () {58 vars in 1152 bytes} [Sat Jul 2 20:49:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 02 20:49:26.293348 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357e9ef-00d2-40c9-9efe-bb64bd04bc87 admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:26.296830 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fad5c-722f-4a9c-988c-1ee240cdc76d admin admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:26.303276 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0357e9ef-00d2-40c9-9efe-bb64bd04bc87 admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:26.307259 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5fad5c-722f-4a9c-988c-1ee240cdc76d admin admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:26.308014 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8e11e-3c23-4400-9884-226a897a9538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:26.308652 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8e11e-3c23-4400-9884-226a897a9538 admin admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:26.308930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8e11e-3c23-4400-9884-226a897a9538 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:26.309196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8e11e-3c23-4400-9884-226a897a9538 admin admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:26.309870 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8e11e-3c23-4400-9884-226a897a9538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:26.311796 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8e11e-3c23-4400-9884-226a897a9538 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:26.312857 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38889e3f-8db9-447a-b4f9-9fcee7a26869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:26.313505 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38889e3f-8db9-447a-b4f9-9fcee7a26869 admin admin] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:26.313782 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38889e3f-8db9-447a-b4f9-9fcee7a26869 admin admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:26.314054 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38889e3f-8db9-447a-b4f9-9fcee7a26869 admin admin] PATH_INFO: `/v3/projects` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:26.314737 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38889e3f-8db9-447a-b4f9-9fcee7a26869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:26.315781 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: WARNING py.warnings [None req-38889e3f-8db9-447a-b4f9-9fcee7a26869 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:49:26.315781 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: warnings.warn(msg) Jul 02 20:49:26.315781 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: Jul 02 20:49:26.316985 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38889e3f-8db9-447a-b4f9-9fcee7a26869 admin admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:26.350282 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 583/1169] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jul 2 20:49:26 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 20:49:26.355271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8e11e-3c23-4400-9884-226a897a9538 admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:26.359003 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 587/1170] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jul 2 20:49:26 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 20:49:26.362943 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38889e3f-8db9-447a-b4f9-9fcee7a26869 admin admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:26.419604 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8e11e-3c23-4400-9884-226a897a9538 admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:26.424603 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15eb043-42e8-4472-86fe-b8f93adf4cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:26.425210 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15eb043-42e8-4472-86fe-b8f93adf4cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:26.425488 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15eb043-42e8-4472-86fe-b8f93adf4cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:26.425786 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15eb043-42e8-4472-86fe-b8f93adf4cb4 admin admin] PATH_INFO: `/v3/users` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:26.426074 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38889e3f-8db9-447a-b4f9-9fcee7a26869 admin admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:26.426468 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15eb043-42e8-4472-86fe-b8f93adf4cb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:26.427517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: WARNING py.warnings [None req-c15eb043-42e8-4472-86fe-b8f93adf4cb4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:49:26.427517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: warnings.warn(msg) Jul 02 20:49:26.427517 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: Jul 02 20:49:26.428712 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15eb043-42e8-4472-86fe-b8f93adf4cb4 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:26.430866 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757002bd-9275-4f54-a978-2b4469cc8c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:26.431561 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757002bd-9275-4f54-a978-2b4469cc8c26 admin admin] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:26.431844 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757002bd-9275-4f54-a978-2b4469cc8c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:26.432117 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757002bd-9275-4f54-a978-2b4469cc8c26 admin admin] PATH_INFO: `/v3/users` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:26.432937 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757002bd-9275-4f54-a978-2b4469cc8c26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:26.434876 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757002bd-9275-4f54-a978-2b4469cc8c26 admin admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:26.450841 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 584/1171] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jul 2 20:49:26 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 20:49:26.455265 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15eb043-42e8-4472-86fe-b8f93adf4cb4 admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:26.455640 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 588/1172] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jul 2 20:49:26 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 20:49:26.459366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757002bd-9275-4f54-a978-2b4469cc8c26 admin admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:26.468655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15eb043-42e8-4472-86fe-b8f93adf4cb4 admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:26.469731 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757002bd-9275-4f54-a978-2b4469cc8c26 admin admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:26.473213 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571853df-a6a4-4070-a6a9-1b08ec89584a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:26.473868 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571853df-a6a4-4070-a6a9-1b08ec89584a admin admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:26.474148 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571853df-a6a4-4070-a6a9-1b08ec89584a admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:26.474427 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571853df-a6a4-4070-a6a9-1b08ec89584a admin admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:26.474677 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e9755-a9ae-4ae0-8e46-0af7609fe50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:26.475276 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571853df-a6a4-4070-a6a9-1b08ec89584a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:26.475381 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e9755-a9ae-4ae0-8e46-0af7609fe50d admin admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:26.475658 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e9755-a9ae-4ae0-8e46-0af7609fe50d admin admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:26.475931 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307e9755-a9ae-4ae0-8e46-0af7609fe50d admin admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:26.476651 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e9755-a9ae-4ae0-8e46-0af7609fe50d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:26.476868 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571853df-a6a4-4070-a6a9-1b08ec89584a admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:26.478367 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307e9755-a9ae-4ae0-8e46-0af7609fe50d admin admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:26.487061 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 585/1173] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jul 2 20:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 20:49:26.490489 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 589/1174] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jul 2 20:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 20:49:26.491421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571853df-a6a4-4070-a6a9-1b08ec89584a admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:26.491960 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e9755-a9ae-4ae0-8e46-0af7609fe50d admin admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:26.501528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571853df-a6a4-4070-a6a9-1b08ec89584a admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:26.501676 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307e9755-a9ae-4ae0-8e46-0af7609fe50d admin admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:26.506352 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10e236-3965-4efa-a02f-24415f4104c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:26.506501 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc47461-f676-44e8-8c6a-a39a79f37df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:26.507030 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10e236-3965-4efa-a02f-24415f4104c8 admin admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:26.507150 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc47461-f676-44e8-8c6a-a39a79f37df4 admin admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:26.507310 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10e236-3965-4efa-a02f-24415f4104c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:26.507418 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc47461-f676-44e8-8c6a-a39a79f37df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:26.507578 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10e236-3965-4efa-a02f-24415f4104c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:26.507673 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc47461-f676-44e8-8c6a-a39a79f37df4 admin admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:26.508302 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc47461-f676-44e8-8c6a-a39a79f37df4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:26.508414 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10e236-3965-4efa-a02f-24415f4104c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:26.509874 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10e236-3965-4efa-a02f-24415f4104c8 admin admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:26.510081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc47461-f676-44e8-8c6a-a39a79f37df4 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:26.520102 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 590/1175] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jul 2 20:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 20:49:26.521551 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 586/1176] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jul 2 20:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 20:49:26.524298 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10e236-3965-4efa-a02f-24415f4104c8 admin admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:26.524876 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc47461-f676-44e8-8c6a-a39a79f37df4 admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:26.533845 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10e236-3965-4efa-a02f-24415f4104c8 admin admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:26.535113 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc47461-f676-44e8-8c6a-a39a79f37df4 admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:26.538509 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cd2cc2-ec72-445b-a8ff-4401fd6e76ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:26.539430 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd2cc2-ec72-445b-a8ff-4401fd6e76ec admin admin] REQUEST_METHOD: `PUT` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:26.539822 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd2cc2-ec72-445b-a8ff-4401fd6e76ec admin admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:26.540143 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cd2cc2-ec72-445b-a8ff-4401fd6e76ec admin admin] PATH_INFO: `/v3/projects/45b48e90ef7440f4904feb460c7e7582/users/d4d76e56460546e1ab7c7edee1d8e241/roles/538580824ccd4e02823540ee3df31cdc` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:26.540286 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ce918-4f70-4bfb-a77d-164e5363496d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:26.541075 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ce918-4f70-4bfb-a77d-164e5363496d admin admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:26.541403 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ce918-4f70-4bfb-a77d-164e5363496d admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:26.541748 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ce918-4f70-4bfb-a77d-164e5363496d admin admin] PATH_INFO: `/v3/projects/c6161dd830234c089769600f91e5cfc0/users/fb9bfe743c9c48839671e43638026bb8/roles/538580824ccd4e02823540ee3df31cdc` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:26.555866 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd2cc2-ec72-445b-a8ff-4401fd6e76ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=45b48e90ef7440f4904feb460c7e7582, user_id=d4d76e56460546e1ab7c7edee1d8e241, role_id=538580824ccd4e02823540ee3df31cdc)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:26.556896 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: WARNING py.warnings [None req-84cd2cc2-ec72-445b-a8ff-4401fd6e76ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 02 20:49:26.556896 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: warnings.warn(msg) Jul 02 20:49:26.556896 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: Jul 02 20:49:26.557223 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ce918-4f70-4bfb-a77d-164e5363496d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6161dd830234c089769600f91e5cfc0, user_id=fb9bfe743c9c48839671e43638026bb8, role_id=538580824ccd4e02823540ee3df31cdc)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:26.558796 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cd2cc2-ec72-445b-a8ff-4401fd6e76ec admin admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:26.559802 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ce918-4f70-4bfb-a77d-164e5363496d admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:26.572505 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 591/1177] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jul 2 20:49:26 2022] PUT /identity/v3/projects/45b48e90ef7440f4904feb460c7e7582/users/d4d76e56460546e1ab7c7edee1d8e241/roles/538580824ccd4e02823540ee3df31cdc => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 20:49:26.578869 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1145ef5-1f74-40cf-a470-5057ca7bf518 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:26.579183 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1145ef5-1f74-40cf-a470-5057ca7bf518 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:26.579456 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1145ef5-1f74-40cf-a470-5057ca7bf518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:26.580449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 587/1178] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jul 2 20:49:26 2022] PUT /identity/v3/projects/c6161dd830234c089769600f91e5cfc0/users/fb9bfe743c9c48839671e43638026bb8/roles/538580824ccd4e02823540ee3df31cdc => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 02 20:49:26.585701 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ad15c-7064-4fd9-8d2f-1d40e0e14c4d None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:26.585996 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ad15c-7064-4fd9-8d2f-1d40e0e14c4d None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:26.586325 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ad15c-7064-4fd9-8d2f-1d40e0e14c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:26.599304 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-f1145ef5-1f74-40cf-a470-5057ca7bf518 None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:49:26.600510 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-f1145ef5-1f74-40cf-a470-5057ca7bf518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:26.603658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-c75ad15c-7064-4fd9-8d2f-1d40e0e14c4d None None] MFA Rules not processed for user `a74d0c542d434c4296a1d1b26dca9bac`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:49:26.604814 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-c75ad15c-7064-4fd9-8d2f-1d40e0e14c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:26.643522 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:49:26.646362 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:49:26.666665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 588/1179] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jul 2 20:49:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:49:26.667915 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 592/1180] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jul 2 20:49:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:49:26.674066 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ad15c-7064-4fd9-8d2f-1d40e0e14c4d None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:26.678091 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1145ef5-1f74-40cf-a470-5057ca7bf518 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:26.733042 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1145ef5-1f74-40cf-a470-5057ca7bf518 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:26.735722 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ad15c-7064-4fd9-8d2f-1d40e0e14c4d None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:26.736734 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea7cdd-c7a9-48d2-a37d-5e777a0df85c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:26.737370 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea7cdd-c7a9-48d2-a37d-5e777a0df85c service neutron] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:26.737650 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea7cdd-c7a9-48d2-a37d-5e777a0df85c service neutron] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:26.737921 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea7cdd-c7a9-48d2-a37d-5e777a0df85c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:26.739400 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afd1f3-2c6f-4703-9514-eff81f9fcfca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:26.740053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afd1f3-2c6f-4703-9514-eff81f9fcfca service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:26.740336 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afd1f3-2c6f-4703-9514-eff81f9fcfca service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:26.740611 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afd1f3-2c6f-4703-9514-eff81f9fcfca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:26.747099 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea7cdd-c7a9-48d2-a37d-5e777a0df85c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:26.748547 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea7cdd-c7a9-48d2-a37d-5e777a0df85c service neutron] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:26.749801 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afd1f3-2c6f-4703-9514-eff81f9fcfca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:26.751271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afd1f3-2c6f-4703-9514-eff81f9fcfca service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:26.757885 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 593/1181] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:49:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 20:49:26.760899 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 589/1182] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:49:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 20:49:31.718509 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b886420-7de6-4635-bb78-8060dda96f6c None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:31.723393 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b886420-7de6-4635-bb78-8060dda96f6c None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:31.723851 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b886420-7de6-4635-bb78-8060dda96f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:31.793965 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-7b886420-7de6-4635-bb78-8060dda96f6c None None] MFA Rules not processed for user `d4d76e56460546e1ab7c7edee1d8e241`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:49:31.795256 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-7b886420-7de6-4635-bb78-8060dda96f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:31.889868 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed3ff8-b9c6-42ce-955a-fd004036e004 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:31.890453 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed3ff8-b9c6-42ce-955a-fd004036e004 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:31.891053 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ed3ff8-b9c6-42ce-955a-fd004036e004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:31.940961 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-a8ed3ff8-b9c6-42ce-955a-fd004036e004 None None] MFA Rules not processed for user `fb9bfe743c9c48839671e43638026bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:49:31.945958 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-a8ed3ff8-b9c6-42ce-955a-fd004036e004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:31.948091 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 594/1183] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jul 2 20:49:31 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:49:31.952657 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b886420-7de6-4635-bb78-8060dda96f6c None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:31.975266 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b886420-7de6-4635-bb78-8060dda96f6c None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:31.995495 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546aef7a-4862-4600-a89a-6ff58bac5463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:31.996184 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546aef7a-4862-4600-a89a-6ff58bac5463 admin admin] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:31.996572 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546aef7a-4862-4600-a89a-6ff58bac5463 admin admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:31.996849 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546aef7a-4862-4600-a89a-6ff58bac5463 admin admin] PATH_INFO: `/v3/projects` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:31.997769 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546aef7a-4862-4600-a89a-6ff58bac5463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:32.003768 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546aef7a-4862-4600-a89a-6ff58bac5463 admin admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:32.053192 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 595/1184] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jul 2 20:49:31 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 20:49:32.057412 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546aef7a-4862-4600-a89a-6ff58bac5463 admin admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:32.096468 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 590/1185] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jul 2 20:49:31 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 20:49:32.101320 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed3ff8-b9c6-42ce-955a-fd004036e004 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:32.121425 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ed3ff8-b9c6-42ce-955a-fd004036e004 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:32.186020 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:49:32.193514 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546aef7a-4862-4600-a89a-6ff58bac5463 admin admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:32.216789 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f492cdc-17dc-40f7-b93a-5155d68c2ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:32.217510 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f492cdc-17dc-40f7-b93a-5155d68c2ac0 admin admin] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:32.217988 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f492cdc-17dc-40f7-b93a-5155d68c2ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:32.218265 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f492cdc-17dc-40f7-b93a-5155d68c2ac0 admin admin] PATH_INFO: `/v3/users` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:32.222505 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f492cdc-17dc-40f7-b93a-5155d68c2ac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:32.224584 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f492cdc-17dc-40f7-b93a-5155d68c2ac0 admin admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:32.266385 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 596/1186] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jul 2 20:49:32 2022] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 02 20:49:32.270415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1a9a6-f462-48b2-aa0c-bffcc57c77c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:32.270415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1a9a6-f462-48b2-aa0c-bffcc57c77c9 admin admin] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:32.270415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1a9a6-f462-48b2-aa0c-bffcc57c77c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:32.270415 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e1a9a6-f462-48b2-aa0c-bffcc57c77c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:32.270925 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1a9a6-f462-48b2-aa0c-bffcc57c77c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:32.271018 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f492cdc-17dc-40f7-b93a-5155d68c2ac0 admin admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:32.274549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e1a9a6-f462-48b2-aa0c-bffcc57c77c9 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:32.296050 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f492cdc-17dc-40f7-b93a-5155d68c2ac0 admin admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:32.301654 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9c464-6154-4fab-abf9-c50ff9390e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:32.302491 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9c464-6154-4fab-abf9-c50ff9390e61 admin admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:32.302775 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9c464-6154-4fab-abf9-c50ff9390e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:32.303108 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9c464-6154-4fab-abf9-c50ff9390e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:32.303887 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9c464-6154-4fab-abf9-c50ff9390e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:32.305820 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9c464-6154-4fab-abf9-c50ff9390e61 admin admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:32.314564 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 591/1187] 10.222.0.57 () {60 vars in 1152 bytes} [Sat Jul 2 20:49:32 2022] POST /identity/v3/projects => generated 379 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:49:32.320814 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 597/1188] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jul 2 20:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 20:49:32.323123 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1a9a6-f462-48b2-aa0c-bffcc57c77c9 admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:32.324172 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9c464-6154-4fab-abf9-c50ff9390e61 admin admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:32.332797 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:49:32.346868 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9c464-6154-4fab-abf9-c50ff9390e61 admin admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:32.457835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4f33d-82f1-493e-bd9a-26381f295f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:32.458807 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4f33d-82f1-493e-bd9a-26381f295f7b admin admin] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:32.459461 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4f33d-82f1-493e-bd9a-26381f295f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:32.459815 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4f33d-82f1-493e-bd9a-26381f295f7b admin admin] PATH_INFO: `/v3/users` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:32.460631 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4f33d-82f1-493e-bd9a-26381f295f7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:32.463401 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4f33d-82f1-493e-bd9a-26381f295f7b admin admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:32.463767 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e1a9a6-f462-48b2-aa0c-bffcc57c77c9 admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:32.472113 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d8ea0-6e87-4cef-9db8-5ef0ceb28691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:32.474302 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d8ea0-6e87-4cef-9db8-5ef0ceb28691 admin admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:32.474942 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d8ea0-6e87-4cef-9db8-5ef0ceb28691 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:32.479534 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303d8ea0-6e87-4cef-9db8-5ef0ceb28691 admin admin] PATH_INFO: `/v3/projects/961fa45d741f4dcdae61c64ce77ce023/users/1aba3a08f67c467c8e8067ba59668feb/roles/353a58700c5640988ce2c9012e847cf8` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:32.488411 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 598/1189] 10.222.0.57 () {60 vars in 1143 bytes} [Sat Jul 2 20:49:32 2022] POST /identity/v3/users => generated 296 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 02 20:49:32.492111 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4f33d-82f1-493e-bd9a-26381f295f7b admin admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:32.501124 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d8ea0-6e87-4cef-9db8-5ef0ceb28691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=961fa45d741f4dcdae61c64ce77ce023, user_id=1aba3a08f67c467c8e8067ba59668feb, role_id=353a58700c5640988ce2c9012e847cf8)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:32.503216 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4f33d-82f1-493e-bd9a-26381f295f7b admin admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:32.503969 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303d8ea0-6e87-4cef-9db8-5ef0ceb28691 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:32.508503 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353192f-8757-483d-8f65-9459fcbe8ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:32.509449 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353192f-8757-483d-8f65-9459fcbe8ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:32.509850 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353192f-8757-483d-8f65-9459fcbe8ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:32.510261 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353192f-8757-483d-8f65-9459fcbe8ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:32.511141 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353192f-8757-483d-8f65-9459fcbe8ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:32.512952 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353192f-8757-483d-8f65-9459fcbe8ec2 admin admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:32.523391 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 592/1190] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jul 2 20:49:32 2022] PUT /identity/v3/projects/961fa45d741f4dcdae61c64ce77ce023/users/1aba3a08f67c467c8e8067ba59668feb/roles/353a58700c5640988ce2c9012e847cf8 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:49:32.527959 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d8ea0-6e87-4cef-9db8-5ef0ceb28691 admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:32.530073 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 599/1191] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jul 2 20:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 02 20:49:32.530822 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353192f-8757-483d-8f65-9459fcbe8ec2 admin admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:32.541119 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353192f-8757-483d-8f65-9459fcbe8ec2 admin admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:32.607220 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bf52c-c3e1-49c5-b1ca-173c7553d412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:32.608143 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bf52c-c3e1-49c5-b1ca-173c7553d412 admin admin] REQUEST_METHOD: `PUT` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:32.608419 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bf52c-c3e1-49c5-b1ca-173c7553d412 admin admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:32.608689 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308bf52c-c3e1-49c5-b1ca-173c7553d412 admin admin] PATH_INFO: `/v3/projects/56da4f78f5124863a6e8d6021f8e6d0c/users/8a1f070244384f20a74c70dfe0b597b1/roles/353a58700c5640988ce2c9012e847cf8` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:32.623778 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303d8ea0-6e87-4cef-9db8-5ef0ceb28691 admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:32.642878 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bf52c-c3e1-49c5-b1ca-173c7553d412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56da4f78f5124863a6e8d6021f8e6d0c, user_id=8a1f070244384f20a74c70dfe0b597b1, role_id=353a58700c5640988ce2c9012e847cf8)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:32.645472 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb7ba5-9629-4bd6-91db-63dc54efaefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:32.646181 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb7ba5-9629-4bd6-91db-63dc54efaefb admin admin] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:32.646471 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb7ba5-9629-4bd6-91db-63dc54efaefb admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:32.646748 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb7ba5-9629-4bd6-91db-63dc54efaefb admin admin] PATH_INFO: `/v3/roles` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:32.648574 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb7ba5-9629-4bd6-91db-63dc54efaefb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:32.649175 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308bf52c-c3e1-49c5-b1ca-173c7553d412 admin admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:32.650323 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eceb7ba5-9629-4bd6-91db-63dc54efaefb admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:32.662957 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 593/1192] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jul 2 20:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 20:49:32.665622 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb7ba5-9629-4bd6-91db-63dc54efaefb admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:32.674734 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 600/1193] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jul 2 20:49:32 2022] PUT /identity/v3/projects/56da4f78f5124863a6e8d6021f8e6d0c/users/8a1f070244384f20a74c70dfe0b597b1/roles/353a58700c5640988ce2c9012e847cf8 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:49:32.675961 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bf52c-c3e1-49c5-b1ca-173c7553d412 admin admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:32.679514 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb7ba5-9629-4bd6-91db-63dc54efaefb admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:32.747434 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:49:32.764749 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb9437-081f-40a8-9bb4-c79e103711fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:32.765910 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb9437-081f-40a8-9bb4-c79e103711fb admin admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:32.766141 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb9437-081f-40a8-9bb4-c79e103711fb admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:32.766421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb9437-081f-40a8-9bb4-c79e103711fb admin admin] PATH_INFO: `/v3/projects/961fa45d741f4dcdae61c64ce77ce023/users/1aba3a08f67c467c8e8067ba59668feb/roles/353a58700c5640988ce2c9012e847cf8` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:32.768866 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb9437-081f-40a8-9bb4-c79e103711fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=961fa45d741f4dcdae61c64ce77ce023, user_id=1aba3a08f67c467c8e8067ba59668feb, role_id=353a58700c5640988ce2c9012e847cf8)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:32.771855 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcb9437-081f-40a8-9bb4-c79e103711fb admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:32.783257 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308bf52c-c3e1-49c5-b1ca-173c7553d412 admin admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:32.788820 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 594/1194] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jul 2 20:49:32 2022] PUT /identity/v3/projects/961fa45d741f4dcdae61c64ce77ce023/users/1aba3a08f67c467c8e8067ba59668feb/roles/353a58700c5640988ce2c9012e847cf8 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:49:32.870431 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cecce3-9c98-4958-8a4d-224ef63373c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:32.871199 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cecce3-9c98-4958-8a4d-224ef63373c0 admin admin] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:32.871655 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cecce3-9c98-4958-8a4d-224ef63373c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:32.871754 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cecce3-9c98-4958-8a4d-224ef63373c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:32.872453 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cecce3-9c98-4958-8a4d-224ef63373c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:32.874092 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cecce3-9c98-4958-8a4d-224ef63373c0 admin admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:32.888396 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 601/1195] 10.222.0.57 () {58 vars in 1121 bytes} [Sat Jul 2 20:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 02 20:49:32.893551 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb9437-081f-40a8-9bb4-c79e103711fb admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:32.910845 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcb9437-081f-40a8-9bb4-c79e103711fb admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:32.916398 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d106a-8fa1-44e2-a586-9391f90c5025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:32.917328 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d106a-8fa1-44e2-a586-9391f90c5025 admin admin] REQUEST_METHOD: `PUT` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:32.917607 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d106a-8fa1-44e2-a586-9391f90c5025 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:32.917879 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d106a-8fa1-44e2-a586-9391f90c5025 admin admin] PATH_INFO: `/v3/projects/56da4f78f5124863a6e8d6021f8e6d0c/users/8a1f070244384f20a74c70dfe0b597b1/roles/353a58700c5640988ce2c9012e847cf8` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:32.923848 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d106a-8fa1-44e2-a586-9391f90c5025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56da4f78f5124863a6e8d6021f8e6d0c, user_id=8a1f070244384f20a74c70dfe0b597b1, role_id=353a58700c5640988ce2c9012e847cf8)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:32.926577 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d106a-8fa1-44e2-a586-9391f90c5025 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:32.940921 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 595/1196] 10.222.0.57 () {60 vars in 1482 bytes} [Sat Jul 2 20:49:32 2022] PUT /identity/v3/projects/56da4f78f5124863a6e8d6021f8e6d0c/users/8a1f070244384f20a74c70dfe0b597b1/roles/353a58700c5640988ce2c9012e847cf8 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:49:38.653634 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc86dc-1025-49f5-b481-c9c410f379ec None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:38.654228 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc86dc-1025-49f5-b481-c9c410f379ec None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:38.654228 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc86dc-1025-49f5-b481-c9c410f379ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:38.688144 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-a9bc86dc-1025-49f5-b481-c9c410f379ec None None] MFA Rules not processed for user `8a1f070244384f20a74c70dfe0b597b1`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:49:38.689398 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-a9bc86dc-1025-49f5-b481-c9c410f379ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:38.823366 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 602/1197] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jul 2 20:49:38 2022] POST /identity/v3/auth/tokens => generated 2873 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:49:38.847441 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d106a-8fa1-44e2-a586-9391f90c5025 admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:38.850168 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-735d106a-8fa1-44e2-a586-9391f90c5025 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:38.858432 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:49:38.992322 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d106a-8fa1-44e2-a586-9391f90c5025 admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:38.996978 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d5989-e1ef-4e11-bd84-de02cd5c2632 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3685e7474a40b0ba9115283446d430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:38.997949 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d5989-e1ef-4e11-bd84-de02cd5c2632 service glance] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:38.998425 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d5989-e1ef-4e11-bd84-de02cd5c2632 service glance] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:38.998893 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031d5989-e1ef-4e11-bd84-de02cd5c2632 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:39.114864 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725a9b4-7b6f-4aa4-a7ae-87beaca9b406 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:39.115232 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725a9b4-7b6f-4aa4-a7ae-87beaca9b406 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:39.115515 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0725a9b4-7b6f-4aa4-a7ae-87beaca9b406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:39.127758 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d5989-e1ef-4e11-bd84-de02cd5c2632 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:39.129270 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031d5989-e1ef-4e11-bd84-de02cd5c2632 service glance] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:39.148327 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 596/1198] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:49:38 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:49:39.159069 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-0725a9b4-7b6f-4aa4-a7ae-87beaca9b406 None None] MFA Rules not processed for user `1aba3a08f67c467c8e8067ba59668feb`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:49:39.161695 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-0725a9b4-7b6f-4aa4-a7ae-87beaca9b406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:39.274284 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=100 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:49:39.338179 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 603/1199] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jul 2 20:49:39 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 20:49:39.346224 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d5989-e1ef-4e11-bd84-de02cd5c2632 service glance] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:39.347838 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-031d5989-e1ef-4e11-bd84-de02cd5c2632 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:39.369966 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031d5989-e1ef-4e11-bd84-de02cd5c2632 service glance] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:39.379610 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6965dd11-b4b8-4387-8f4e-d780561c992e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3685e7474a40b0ba9115283446d430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:39.380303 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965dd11-b4b8-4387-8f4e-d780561c992e service glance] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:39.380580 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965dd11-b4b8-4387-8f4e-d780561c992e service glance] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:39.380853 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6965dd11-b4b8-4387-8f4e-d780561c992e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:39.513956 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965dd11-b4b8-4387-8f4e-d780561c992e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:39.515355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6965dd11-b4b8-4387-8f4e-d780561c992e service glance] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:39.539816 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 597/1200] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:49:39 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:49:47.909761 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40459915-0a75-401b-b1ed-efe674519736 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:47.910296 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40459915-0a75-401b-b1ed-efe674519736 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:47.910501 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40459915-0a75-401b-b1ed-efe674519736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:47.931339 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-40459915-0a75-401b-b1ed-efe674519736 None None] MFA Rules not processed for user `d4d76e56460546e1ab7c7edee1d8e241`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:49:47.932702 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-40459915-0a75-401b-b1ed-efe674519736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:47.942959 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 604/1201] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jul 2 20:49:47 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:49:48.258131 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e26f7-287c-4ee7-b18e-e200c284c0e9 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:48.259314 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e26f7-287c-4ee7-b18e-e200c284c0e9 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:48.259817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e26f7-287c-4ee7-b18e-e200c284c0e9 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:48.262050 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 598/1202] 10.222.0.57 () {54 vars in 961 bytes} [Sat Jul 2 20:49:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:49:48.277575 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f4425-f1d9-4afc-a543-c1756d888c72 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:48.277873 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f4425-f1d9-4afc-a543-c1756d888c72 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:48.278149 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4f4425-f1d9-4afc-a543-c1756d888c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:48.329504 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-cf4f4425-f1d9-4afc-a543-c1756d888c72 None None] MFA Rules not processed for user `eec825336f2e408ebabdcfd29845d5ad`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:49:48.330754 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-cf4f4425-f1d9-4afc-a543-c1756d888c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:48.402439 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 605/1203] 10.222.0.57 () {58 vars in 1058 bytes} [Sat Jul 2 20:49:48 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:49:48.408338 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570984dd-0659-45fa-a09c-ef3398956575 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:48.408718 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570984dd-0659-45fa-a09c-ef3398956575 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:48.408999 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570984dd-0659-45fa-a09c-ef3398956575 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:48.410382 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 599/1204] 10.222.0.57 () {54 vars in 912 bytes} [Sat Jul 2 20:49:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:49:48.416229 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bbd8d-524c-4eea-bef3-4cee3e365783 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:48.416650 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bbd8d-524c-4eea-bef3-4cee3e365783 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:48.417614 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bbd8d-524c-4eea-bef3-4cee3e365783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:48.440890 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-fd6bbd8d-524c-4eea-bef3-4cee3e365783 None None] MFA Rules not processed for user `eec825336f2e408ebabdcfd29845d5ad`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:49:48.442384 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-fd6bbd8d-524c-4eea-bef3-4cee3e365783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:48.453275 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 606/1205] 10.222.0.57 () {58 vars in 1009 bytes} [Sat Jul 2 20:49:48 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:49:48.464961 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570984dd-0659-45fa-a09c-ef3398956575 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:48.476244 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570984dd-0659-45fa-a09c-ef3398956575 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:48.480446 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40c4e16-cdcd-44aa-9d7e-c3aacf5d85f6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3685e7474a40b0ba9115283446d430', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:48.481162 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c4e16-cdcd-44aa-9d7e-c3aacf5d85f6 service glance] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:48.481527 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c4e16-cdcd-44aa-9d7e-c3aacf5d85f6 service glance] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:48.481791 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40c4e16-cdcd-44aa-9d7e-c3aacf5d85f6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:48.501906 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c4e16-cdcd-44aa-9d7e-c3aacf5d85f6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:48.503271 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40c4e16-cdcd-44aa-9d7e-c3aacf5d85f6 service glance] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:48.517156 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 600/1206] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:49:48 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:49:48.851906 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eeeae7-6246-48f4-9288-cf18abafd255 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:48.852278 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eeeae7-6246-48f4-9288-cf18abafd255 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:48.852559 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eeeae7-6246-48f4-9288-cf18abafd255 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:48.853933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 607/1207] 10.222.0.57 () {54 vars in 912 bytes} [Sat Jul 2 20:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:49:48.859108 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508ddde-5bb1-4617-ba1d-82b2156ff95f None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:48.859469 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508ddde-5bb1-4617-ba1d-82b2156ff95f None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:48.859817 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6508ddde-5bb1-4617-ba1d-82b2156ff95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:48.878337 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-6508ddde-5bb1-4617-ba1d-82b2156ff95f None None] MFA Rules not processed for user `bfcc022be567428db48e7b2a71d9c069`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:49:48.879567 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-6508ddde-5bb1-4617-ba1d-82b2156ff95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:48.908945 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=100 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:49:48.931849 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 601/1208] 10.222.0.57 () {58 vars in 1009 bytes} [Sat Jul 2 20:49:48 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:49:48.942669 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eeeae7-6246-48f4-9288-cf18abafd255 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:48.954100 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eeeae7-6246-48f4-9288-cf18abafd255 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:48.957792 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a47a4f9-3f0b-4a57-85f6-86857294dd60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:48.958432 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47a4f9-3f0b-4a57-85f6-86857294dd60 service neutron] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:48.958707 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47a4f9-3f0b-4a57-85f6-86857294dd60 service neutron] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:48.959001 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a47a4f9-3f0b-4a57-85f6-86857294dd60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:48.966145 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47a4f9-3f0b-4a57-85f6-86857294dd60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:48.967678 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a47a4f9-3f0b-4a57-85f6-86857294dd60 service neutron] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:48.975561 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 608/1209] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:49:48 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:49:49.384867 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9f7ae-2b13-4d71-874b-4d673857d7b1 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:49.385552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9f7ae-2b13-4d71-874b-4d673857d7b1 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:49.385552 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9f7ae-2b13-4d71-874b-4d673857d7b1 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:49.389174 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 602/1210] 10.222.0.57 () {54 vars in 961 bytes} [Sat Jul 2 20:49:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:49:49.395728 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c773b4-ec23-4358-b26f-1efb3cfcf1d4 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:49.396015 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c773b4-ec23-4358-b26f-1efb3cfcf1d4 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:49.396290 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c773b4-ec23-4358-b26f-1efb3cfcf1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:49.415500 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-a6c773b4-ec23-4358-b26f-1efb3cfcf1d4 None None] MFA Rules not processed for user `eec825336f2e408ebabdcfd29845d5ad`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:49:49.422809 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-a6c773b4-ec23-4358-b26f-1efb3cfcf1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:49.424441 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a691c-dffb-4d85-a394-28d73dd2e752 None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:49.424733 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a691c-dffb-4d85-a394-28d73dd2e752 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:49.425015 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a691c-dffb-4d85-a394-28d73dd2e752 None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:49.426402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 603/1211] 10.222.0.57 () {54 vars in 960 bytes} [Sat Jul 2 20:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:49:49.431656 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819708f-3788-4d5d-af83-655f4064b374 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:49.431945 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819708f-3788-4d5d-af83-655f4064b374 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:49.432217 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c819708f-3788-4d5d-af83-655f4064b374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:49.433343 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 609/1212] 10.222.0.57 () {58 vars in 1058 bytes} [Sat Jul 2 20:49:49 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:49:49.438755 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315baf9-f621-4547-8d0a-c16d5bdf2024 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:49.439082 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315baf9-f621-4547-8d0a-c16d5bdf2024 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:49.439365 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8315baf9-f621-4547-8d0a-c16d5bdf2024 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:49.441112 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 610/1213] 10.222.0.57 () {54 vars in 912 bytes} [Sat Jul 2 20:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 02 20:49:49.446733 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ca91a-ce42-483b-ae4a-b694061cd034 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:49.447129 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ca91a-ce42-483b-ae4a-b694061cd034 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:49.447332 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ca91a-ce42-483b-ae4a-b694061cd034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:49.460291 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-c819708f-3788-4d5d-af83-655f4064b374 None None] MFA Rules not processed for user `f2377f751a584f678c0ddebc4de0ae44`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:49:49.461685 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-c819708f-3788-4d5d-af83-655f4064b374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:49.476160 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-a33ca91a-ce42-483b-ae4a-b694061cd034 None None] MFA Rules not processed for user `eec825336f2e408ebabdcfd29845d5ad`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:49:49.477592 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-a33ca91a-ce42-483b-ae4a-b694061cd034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:49.487856 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 611/1214] 10.222.0.57 () {58 vars in 1009 bytes} [Sat Jul 2 20:49:49 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 20:49:49.499551 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ca91a-ce42-483b-ae4a-b694061cd034 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:49.510647 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ca91a-ce42-483b-ae4a-b694061cd034 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:49.515690 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92c597-8d9c-47fa-ba06-2091b7b74e8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:49.516345 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92c597-8d9c-47fa-ba06-2091b7b74e8e service neutron] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:49.516630 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92c597-8d9c-47fa-ba06-2091b7b74e8e service neutron] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:49.516889 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92c597-8d9c-47fa-ba06-2091b7b74e8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:49.527105 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92c597-8d9c-47fa-ba06-2091b7b74e8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:49.528544 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92c597-8d9c-47fa-ba06-2091b7b74e8e service neutron] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:49.535773 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 604/1215] 10.222.0.57 () {58 vars in 1057 bytes} [Sat Jul 2 20:49:49 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 20:49:49.540004 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 612/1216] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:49:49 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 20:49:49.543786 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819708f-3788-4d5d-af83-655f4064b374 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:49:49.554387 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c819708f-3788-4d5d-af83-655f4064b374 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:49:49.559902 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25f842-5f9d-4770-83a3-9373b96d75a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2377f751a584f678c0ddebc4de0ae44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:49:49.560549 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25f842-5f9d-4770-83a3-9373b96d75a4 service placement] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:49:49.560833 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25f842-5f9d-4770-83a3-9373b96d75a4 service placement] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:49:49.561099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f25f842-5f9d-4770-83a3-9373b96d75a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:49:49.562830 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-2f25f842-5f9d-4770-83a3-9373b96d75a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:49:49.575823 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25f842-5f9d-4770-83a3-9373b96d75a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:49:49.577760 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f25f842-5f9d-4770-83a3-9373b96d75a4 service placement] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:49:49.590076 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 605/1217] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:49:49 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 20:49:59.535035 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=62 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:49:59.590207 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=43 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:01.101411 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f99c0-bdf9-4063-9949-12a69be5fe5c None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:01.101933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f99c0-bdf9-4063-9949-12a69be5fe5c None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:01.101933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f99c0-bdf9-4063-9949-12a69be5fe5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:01.120925 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-d90f99c0-bdf9-4063-9949-12a69be5fe5c None None] MFA Rules not processed for user `bfcc022be567428db48e7b2a71d9c069`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:01.122250 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-d90f99c0-bdf9-4063-9949-12a69be5fe5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:01.128951 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 613/1218] 10.222.0.61 () {58 vars in 1015 bytes} [Sat Jul 2 20:50:01 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:01.140665 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25f842-5f9d-4770-83a3-9373b96d75a4 service placement] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:50:01.150832 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f25f842-5f9d-4770-83a3-9373b96d75a4 service placement] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:50:01.155064 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7504d096-6b33-4db8-b7f8-e24adab60155 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:50:01.155711 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504d096-6b33-4db8-b7f8-e24adab60155 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:01.155990 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504d096-6b33-4db8-b7f8-e24adab60155 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:01.156258 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504d096-6b33-4db8-b7f8-e24adab60155 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:01.164102 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504d096-6b33-4db8-b7f8-e24adab60155 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:50:01.165589 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7504d096-6b33-4db8-b7f8-e24adab60155 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:50:01.173980 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 606/1219] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:50:01 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:50:01.927449 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c210d-e0a5-45d8-bd29-6b13074b49c6 None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:01.927783 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c210d-e0a5-45d8-bd29-6b13074b49c6 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:01.928057 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c210d-e0a5-45d8-bd29-6b13074b49c6 None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:01.929991 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 614/1220] 10.222.0.57 () {54 vars in 921 bytes} [Sat Jul 2 20:50:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:50:01.938114 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697941de-8d3a-4e35-92e7-7c300253e543 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:01.938402 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697941de-8d3a-4e35-92e7-7c300253e543 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:01.938728 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697941de-8d3a-4e35-92e7-7c300253e543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:01.969578 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-697941de-8d3a-4e35-92e7-7c300253e543 None None] MFA Rules not processed for user `eec825336f2e408ebabdcfd29845d5ad`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:01.970829 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-697941de-8d3a-4e35-92e7-7c300253e543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:01.990577 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 607/1221] 10.222.0.57 () {58 vars in 1018 bytes} [Sat Jul 2 20:50:01 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:02.017189 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c210d-e0a5-45d8-bd29-6b13074b49c6 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:50:02.044660 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c210d-e0a5-45d8-bd29-6b13074b49c6 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:50:02.053045 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e6a1c-cef2-40e5-98c2-b37b42f8baf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:50:02.054518 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e6a1c-cef2-40e5-98c2-b37b42f8baf0 service nova] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:02.056114 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e6a1c-cef2-40e5-98c2-b37b42f8baf0 service nova] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:02.058148 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e6a1c-cef2-40e5-98c2-b37b42f8baf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:02.069350 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e6a1c-cef2-40e5-98c2-b37b42f8baf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:50:02.071649 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e6a1c-cef2-40e5-98c2-b37b42f8baf0 service nova] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:50:02.098079 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 615/1222] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:50:02 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:50:09.272494 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35155b54-e8a7-4882-91da-457a43033fcf None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:09.273199 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35155b54-e8a7-4882-91da-457a43033fcf None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:09.273304 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35155b54-e8a7-4882-91da-457a43033fcf None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:09.274690 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 608/1223] 10.222.0.57 () {54 vars in 921 bytes} [Sat Jul 2 20:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:50:09.283982 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df7740-d491-43fb-a0f8-9fc9a40761a4 None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:09.284445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df7740-d491-43fb-a0f8-9fc9a40761a4 None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:09.284445 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df7740-d491-43fb-a0f8-9fc9a40761a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:09.307767 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-d3df7740-d491-43fb-a0f8-9fc9a40761a4 None None] MFA Rules not processed for user `eec825336f2e408ebabdcfd29845d5ad`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:09.309864 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-d3df7740-d491-43fb-a0f8-9fc9a40761a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:09.319954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 616/1224] 10.222.0.57 () {58 vars in 1018 bytes} [Sat Jul 2 20:50:09 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:09.334012 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35155b54-e8a7-4882-91da-457a43033fcf None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:50:09.348513 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35155b54-e8a7-4882-91da-457a43033fcf None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:50:09.354162 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeda912f-aae4-4620-ae69-6889be5cdd19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:50:09.354424 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda912f-aae4-4620-ae69-6889be5cdd19 service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:09.354709 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda912f-aae4-4620-ae69-6889be5cdd19 service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:09.355017 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda912f-aae4-4620-ae69-6889be5cdd19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:09.364275 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda912f-aae4-4620-ae69-6889be5cdd19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:50:09.366107 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeda912f-aae4-4620-ae69-6889be5cdd19 service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:50:09.377397 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 609/1225] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:50:09 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:50:19.299863 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=12 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:19.372329 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=15 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:22.228806 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df7740-d491-43fb-a0f8-9fc9a40761a4 None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:50:22.238312 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df7740-d491-43fb-a0f8-9fc9a40761a4 None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:50:22.242206 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7d8c5a-2c18-4511-a0b4-131f50d2db37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:50:22.242981 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d8c5a-2c18-4511-a0b4-131f50d2db37 service neutron] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:22.243270 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d8c5a-2c18-4511-a0b4-131f50d2db37 service neutron] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:22.243542 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7d8c5a-2c18-4511-a0b4-131f50d2db37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:22.252665 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d8c5a-2c18-4511-a0b4-131f50d2db37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:50:22.254083 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7d8c5a-2c18-4511-a0b4-131f50d2db37 service neutron] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:50:22.263945 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 617/1226] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:50:22 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:50:26.274510 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab065c7d-6d96-4c85-88da-908848fb760b None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:26.275122 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab065c7d-6d96-4c85-88da-908848fb760b None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:26.275122 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab065c7d-6d96-4c85-88da-908848fb760b None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:26.276500 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 610/1227] 10.222.0.57 () {54 vars in 921 bytes} [Sat Jul 2 20:50:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:50:26.285032 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35969e0d-e0c0-4051-a659-11f62034da1c None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:26.285938 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35969e0d-e0c0-4051-a659-11f62034da1c None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:26.286377 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35969e0d-e0c0-4051-a659-11f62034da1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:26.317682 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-35969e0d-e0c0-4051-a659-11f62034da1c None None] MFA Rules not processed for user `eec825336f2e408ebabdcfd29845d5ad`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:26.319373 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-35969e0d-e0c0-4051-a659-11f62034da1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:26.330010 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 618/1228] 10.222.0.57 () {58 vars in 1018 bytes} [Sat Jul 2 20:50:26 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:26.374980 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab065c7d-6d96-4c85-88da-908848fb760b None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:50:26.394675 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab065c7d-6d96-4c85-88da-908848fb760b None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:50:26.418355 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f533026-7169-4054-9fa1-40d02cf03249 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:50:26.419489 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f533026-7169-4054-9fa1-40d02cf03249 service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:26.420006 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f533026-7169-4054-9fa1-40d02cf03249 service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:26.420516 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f533026-7169-4054-9fa1-40d02cf03249 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:26.434165 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f533026-7169-4054-9fa1-40d02cf03249 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:50:26.436200 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f533026-7169-4054-9fa1-40d02cf03249 service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:50:26.450414 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 611/1229] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:50:26 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:50:36.310848 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=9 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:36.443318 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=6 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:50:39.262873 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01523df2-6af7-43ef-88af-57f9836bd71f None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:50:39.263446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01523df2-6af7-43ef-88af-57f9836bd71f None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:50:39.263446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01523df2-6af7-43ef-88af-57f9836bd71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:50:39.285428 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-01523df2-6af7-43ef-88af-57f9836bd71f None None] MFA Rules not processed for user `fb9bfe743c9c48839671e43638026bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:50:39.286657 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-01523df2-6af7-43ef-88af-57f9836bd71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:50:39.295743 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 619/1230] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jul 2 20:50:39 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:50:49.279107 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=3 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:51:05.795664 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6188a0b-9771-45d5-a867-e2dfd3603931 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:05.796189 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6188a0b-9771-45d5-a867-e2dfd3603931 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:05.796189 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6188a0b-9771-45d5-a867-e2dfd3603931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:05.822178 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-c6188a0b-9771-45d5-a867-e2dfd3603931 None None] MFA Rules not processed for user `fb9bfe743c9c48839671e43638026bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:05.824149 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-c6188a0b-9771-45d5-a867-e2dfd3603931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:05.836709 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 612/1231] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jul 2 20:51:05 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:15.814714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=3 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:51:20.563401 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450a2d6-0235-4f72-b1aa-8b0960a47c7a None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:20.563911 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450a2d6-0235-4f72-b1aa-8b0960a47c7a None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:20.563911 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8450a2d6-0235-4f72-b1aa-8b0960a47c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:20.582605 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-8450a2d6-0235-4f72-b1aa-8b0960a47c7a None None] MFA Rules not processed for user `fb9bfe743c9c48839671e43638026bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:20.583898 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-8450a2d6-0235-4f72-b1aa-8b0960a47c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:20.591988 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 620/1232] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jul 2 20:51:20 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:20.869144 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d598ae0-e7d9-4d9a-be3e-a854897876f6 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:20.869658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d598ae0-e7d9-4d9a-be3e-a854897876f6 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:20.869658 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d598ae0-e7d9-4d9a-be3e-a854897876f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:20.889362 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-6d598ae0-e7d9-4d9a-be3e-a854897876f6 None None] MFA Rules not processed for user `bfcc022be567428db48e7b2a71d9c069`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:51:20.890569 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-6d598ae0-e7d9-4d9a-be3e-a854897876f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:51:20.897528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 613/1233] 10.222.0.57 () {58 vars in 1009 bytes} [Sat Jul 2 20:51:20 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:51:20.910288 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450a2d6-0235-4f72-b1aa-8b0960a47c7a None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:51:20.921350 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8450a2d6-0235-4f72-b1aa-8b0960a47c7a None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:51:20.926251 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b2ff6-0fcc-4035-b418-5dc4166475b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:51:20.926892 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b2ff6-0fcc-4035-b418-5dc4166475b2 service neutron] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:51:20.927221 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b2ff6-0fcc-4035-b418-5dc4166475b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:51:20.927468 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b2ff6-0fcc-4035-b418-5dc4166475b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:51:20.935390 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b2ff6-0fcc-4035-b418-5dc4166475b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:51:20.936826 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b2ff6-0fcc-4035-b418-5dc4166475b2 service neutron] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:51:20.944863 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 621/1234] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:51:20 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:51:30.883989 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=3 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:51:30.941482 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=9 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:52:19.577280 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e408172-38a5-48c6-a9ab-acab8b98eb07 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:19.577806 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e408172-38a5-48c6-a9ab-acab8b98eb07 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:19.577900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e408172-38a5-48c6-a9ab-acab8b98eb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:19.605291 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-1e408172-38a5-48c6-a9ab-acab8b98eb07 None None] MFA Rules not processed for user `fb9bfe743c9c48839671e43638026bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:52:19.606499 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-1e408172-38a5-48c6-a9ab-acab8b98eb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:52:19.614289 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 614/1235] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jul 2 20:52:19 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:52:29.597948 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=3 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:52:32.491749 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b2ff6-0fcc-4035-b418-5dc4166475b2 service neutron] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:52:32.509873 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b2ff6-0fcc-4035-b418-5dc4166475b2 service neutron] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:52:32.513762 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a4442-eb6c-4f0e-a71e-5a873b760e55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:52:32.514395 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a4442-eb6c-4f0e-a71e-5a873b760e55 service neutron] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:52:32.514675 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a4442-eb6c-4f0e-a71e-5a873b760e55 service neutron] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:52:32.514975 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8a4442-eb6c-4f0e-a71e-5a873b760e55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:52:32.524181 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a4442-eb6c-4f0e-a71e-5a873b760e55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:52:32.525582 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8a4442-eb6c-4f0e-a71e-5a873b760e55 service neutron] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:52:32.534920 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 622/1236] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:52:32 2022] GET /identity/v3/auth/tokens => generated 2873 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:52:42.530853 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=10 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:53:38.175262 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e408172-38a5-48c6-a9ab-acab8b98eb07 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:53:38.198431 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e408172-38a5-48c6-a9ab-acab8b98eb07 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:53:38.204859 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad2e19-399d-4ede-b841-c27bb79d883e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2377f751a584f678c0ddebc4de0ae44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:53:38.205504 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad2e19-399d-4ede-b841-c27bb79d883e service placement] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:53:38.205762 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad2e19-399d-4ede-b841-c27bb79d883e service placement] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:53:38.206075 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad2e19-399d-4ede-b841-c27bb79d883e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:53:38.214885 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad2e19-399d-4ede-b841-c27bb79d883e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:53:38.216824 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad2e19-399d-4ede-b841-c27bb79d883e service placement] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:53:38.226756 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 615/1237] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:53:38 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:53:48.222973 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=10 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:54:47.659126 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a4442-eb6c-4f0e-a71e-5a873b760e55 service neutron] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:54:47.693206 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8a4442-eb6c-4f0e-a71e-5a873b760e55 service neutron] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:54:47.699608 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af045b5-422c-4623-b6bc-3172e6da1929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:54:47.700258 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af045b5-422c-4623-b6bc-3172e6da1929 service nova] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:54:47.700569 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af045b5-422c-4623-b6bc-3172e6da1929 service nova] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:54:47.700819 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af045b5-422c-4623-b6bc-3172e6da1929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:54:47.713336 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af045b5-422c-4623-b6bc-3172e6da1929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:54:47.715193 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af045b5-422c-4623-b6bc-3172e6da1929 service nova] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:54:47.726294 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 623/1238] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:54:47 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:54:47.919543 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad2e19-399d-4ede-b841-c27bb79d883e service placement] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:54:47.930286 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad2e19-399d-4ede-b841-c27bb79d883e service placement] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:54:47.934375 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcefe12-b3f2-4d8e-b4a6-484f70e092f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:54:47.935058 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcefe12-b3f2-4d8e-b4a6-484f70e092f5 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:54:47.935344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcefe12-b3f2-4d8e-b4a6-484f70e092f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:54:47.935617 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcefe12-b3f2-4d8e-b4a6-484f70e092f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:54:47.946583 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcefe12-b3f2-4d8e-b4a6-484f70e092f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:54:47.948080 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcefe12-b3f2-4d8e-b4a6-484f70e092f5 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:54:47.960241 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 616/1239] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:54:47 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:54:49.337824 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af045b5-422c-4623-b6bc-3172e6da1929 service nova] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:54:49.348292 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af045b5-422c-4623-b6bc-3172e6da1929 service nova] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:54:49.352303 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfbf04-dde0-4cd2-82f3-939e88077199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:54:49.352963 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfbf04-dde0-4cd2-82f3-939e88077199 service neutron] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:54:49.353260 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfbf04-dde0-4cd2-82f3-939e88077199 service neutron] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:54:49.353554 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfbf04-dde0-4cd2-82f3-939e88077199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:54:49.363738 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfbf04-dde0-4cd2-82f3-939e88077199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:54:49.365157 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfbf04-dde0-4cd2-82f3-939e88077199 service neutron] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:54:49.376216 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 624/1240] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:54:49 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:54:51.651752 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d6591-9ff8-45bd-9361-6ee341992934 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:54:51.652263 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d6591-9ff8-45bd-9361-6ee341992934 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:54:51.652263 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4d6591-9ff8-45bd-9361-6ee341992934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:54:51.672437 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-bc4d6591-9ff8-45bd-9361-6ee341992934 None None] MFA Rules not processed for user `fb9bfe743c9c48839671e43638026bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:54:51.673778 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-bc4d6591-9ff8-45bd-9361-6ee341992934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:54:51.681316 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 617/1241] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jul 2 20:54:51 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:54:52.483577 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfbf04-dde0-4cd2-82f3-939e88077199 service neutron] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:54:52.495677 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfbf04-dde0-4cd2-82f3-939e88077199 service neutron] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:54:52.501422 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd117b-ea2d-4ae9-a95f-b565dad265d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2377f751a584f678c0ddebc4de0ae44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:54:52.502529 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd117b-ea2d-4ae9-a95f-b565dad265d4 service placement] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:54:52.502835 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd117b-ea2d-4ae9-a95f-b565dad265d4 service placement] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:54:52.503148 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd117b-ea2d-4ae9-a95f-b565dad265d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:54:52.512361 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd117b-ea2d-4ae9-a95f-b565dad265d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:54:52.513949 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cd117b-ea2d-4ae9-a95f-b565dad265d4 service placement] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:54:52.524590 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 625/1242] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:54:52 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:54:58.269992 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d6591-9ff8-45bd-9361-6ee341992934 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:54:58.287934 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4d6591-9ff8-45bd-9361-6ee341992934 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:54:58.294411 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f8a34-83ac-434b-8056-dbfecb3fa2f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:54:58.295111 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f8a34-83ac-434b-8056-dbfecb3fa2f2 service nova] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:54:58.295388 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f8a34-83ac-434b-8056-dbfecb3fa2f2 service nova] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:54:58.295654 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f8a34-83ac-434b-8056-dbfecb3fa2f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:54:58.304439 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f8a34-83ac-434b-8056-dbfecb3fa2f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:54:58.306173 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3f8a34-83ac-434b-8056-dbfecb3fa2f2 service nova] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:54:58.315610 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 618/1243] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:54:58 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:55:01.297116 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd117b-ea2d-4ae9-a95f-b565dad265d4 service placement] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:55:01.307498 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd117b-ea2d-4ae9-a95f-b565dad265d4 service placement] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:55:01.311579 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2260ea-0cb7-49a7-aeb1-d13a22663166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:55:01.312310 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2260ea-0cb7-49a7-aeb1-d13a22663166 service neutron] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:55:01.312594 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2260ea-0cb7-49a7-aeb1-d13a22663166 service neutron] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:55:01.312843 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2260ea-0cb7-49a7-aeb1-d13a22663166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:55:01.314158 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f8a34-83ac-434b-8056-dbfecb3fa2f2 service nova] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:55:01.321733 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2260ea-0cb7-49a7-aeb1-d13a22663166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:55:01.323528 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f8a34-83ac-434b-8056-dbfecb3fa2f2 service nova] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:55:01.324032 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2260ea-0cb7-49a7-aeb1-d13a22663166 service neutron] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:55:01.327649 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b2bba-751d-4180-bdf6-c06435a14c08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:55:01.328292 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b2bba-751d-4180-bdf6-c06435a14c08 service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:55:01.328616 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b2bba-751d-4180-bdf6-c06435a14c08 service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:55:01.328878 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b2bba-751d-4180-bdf6-c06435a14c08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:55:01.332873 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 626/1244] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:55:01 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:55:01.336302 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b2bba-751d-4180-bdf6-c06435a14c08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:55:01.337809 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b2bba-751d-4180-bdf6-c06435a14c08 service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:55:01.347673 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 619/1245] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:55:01 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:55:06.592527 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2260ea-0cb7-49a7-aeb1-d13a22663166 service neutron] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:55:06.608427 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2260ea-0cb7-49a7-aeb1-d13a22663166 service neutron] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:55:06.614918 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef2e86-116c-4a98-8cff-cff5778b592f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:55:06.615607 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef2e86-116c-4a98-8cff-cff5778b592f service nova] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:55:06.616057 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef2e86-116c-4a98-8cff-cff5778b592f service nova] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:55:06.616634 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef2e86-116c-4a98-8cff-cff5778b592f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:55:06.628186 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef2e86-116c-4a98-8cff-cff5778b592f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:55:06.630190 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef2e86-116c-4a98-8cff-cff5778b592f service nova] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:55:06.641569 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 627/1246] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:55:06 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:55:11.343856 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=21 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:55:15.337714 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd32020-684c-4670-a974-a75d74a8b32f None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:55:15.338340 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd32020-684c-4670-a974-a75d74a8b32f None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:55:15.338340 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd32020-684c-4670-a974-a75d74a8b32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:55:15.356385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-fdd32020-684c-4670-a974-a75d74a8b32f None None] MFA Rules not processed for user `d4d76e56460546e1ab7c7edee1d8e241`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:55:15.357588 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-fdd32020-684c-4670-a974-a75d74a8b32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:55:15.365808 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 620/1247] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jul 2 20:55:15 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:55:16.637275 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=34 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:55:25.351421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=3 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:55:35.023984 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef2e86-116c-4a98-8cff-cff5778b592f service nova] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:55:35.035928 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef2e86-116c-4a98-8cff-cff5778b592f service nova] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:55:35.042365 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043899c-f4e6-43b1-aa96-d003e277945c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:55:35.043071 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043899c-f4e6-43b1-aa96-d003e277945c service nova] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:55:35.043346 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043899c-f4e6-43b1-aa96-d003e277945c service nova] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:55:35.043620 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043899c-f4e6-43b1-aa96-d003e277945c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:55:35.052883 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043899c-f4e6-43b1-aa96-d003e277945c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:55:35.054556 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043899c-f4e6-43b1-aa96-d003e277945c service nova] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:55:35.064616 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 628/1248] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:55:35 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:55:43.246638 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd32020-684c-4670-a974-a75d74a8b32f None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:55:43.256544 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd32020-684c-4670-a974-a75d74a8b32f None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:55:43.260870 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee50be-fb04-4b44-a345-8e41151d4b9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:55:43.261532 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee50be-fb04-4b44-a345-8e41151d4b9f service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:55:43.261810 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee50be-fb04-4b44-a345-8e41151d4b9f service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:55:43.262074 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee50be-fb04-4b44-a345-8e41151d4b9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:55:43.272043 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee50be-fb04-4b44-a345-8e41151d4b9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:55:43.273491 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee50be-fb04-4b44-a345-8e41151d4b9f service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:55:43.283685 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 621/1249] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:55:43 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:55:44.871659 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043899c-f4e6-43b1-aa96-d003e277945c service nova] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:55:44.882214 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043899c-f4e6-43b1-aa96-d003e277945c service nova] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:55:44.890741 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f26d0-0f56-447a-ae22-ecebf5151840 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'eec825336f2e408ebabdcfd29845d5ad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:55:44.891648 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f26d0-0f56-447a-ae22-ecebf5151840 service nova] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:55:44.892198 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f26d0-0f56-447a-ae22-ecebf5151840 service nova] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:55:44.892869 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f26d0-0f56-447a-ae22-ecebf5151840 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:55:44.903548 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f26d0-0f56-447a-ae22-ecebf5151840 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:55:44.905183 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f26d0-0f56-447a-ae22-ecebf5151840 service nova] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:55:44.916765 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 629/1250] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:55:44 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:55:53.279482 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=6 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:55:54.912784 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=12 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:56:59.862779 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6803f0-543a-4cb6-a195-c378287af757 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:56:59.863405 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6803f0-543a-4cb6-a195-c378287af757 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:56:59.863405 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6803f0-543a-4cb6-a195-c378287af757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:56:59.882256 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-9b6803f0-543a-4cb6-a195-c378287af757 None None] MFA Rules not processed for user `fb9bfe743c9c48839671e43638026bb8`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:56:59.883508 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-9b6803f0-543a-4cb6-a195-c378287af757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:56:59.891196 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 622/1251] 10.222.0.57 () {58 vars in 957 bytes} [Sat Jul 2 20:56:59 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:57:00.233431 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f26d0-0f56-447a-ae22-ecebf5151840 service nova] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:57:00.243526 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f26d0-0f56-447a-ae22-ecebf5151840 service nova] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:57:00.247453 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8991167-c842-4d9d-a4fe-4b6a21526436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:57:00.248090 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8991167-c842-4d9d-a4fe-4b6a21526436 service neutron] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:57:00.248348 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8991167-c842-4d9d-a4fe-4b6a21526436 service neutron] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:57:00.248616 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8991167-c842-4d9d-a4fe-4b6a21526436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:57:00.257416 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8991167-c842-4d9d-a4fe-4b6a21526436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:57:00.259617 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8991167-c842-4d9d-a4fe-4b6a21526436 service neutron] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:57:00.273344 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 630/1252] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:57:00 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:57:09.876659 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=3 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:57:10.267218 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=6 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:58:17.449603 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6803f0-543a-4cb6-a195-c378287af757 None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:58:17.451930 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-9b6803f0-543a-4cb6-a195-c378287af757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:58:17.521370 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6803f0-543a-4cb6-a195-c378287af757 None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:58:17.525081 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04449b2-866b-4728-82f4-10e3225eac5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:58:17.525758 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04449b2-866b-4728-82f4-10e3225eac5c service neutron] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:58:17.526043 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04449b2-866b-4728-82f4-10e3225eac5c service neutron] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:58:17.526315 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04449b2-866b-4728-82f4-10e3225eac5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:58:17.625362 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04449b2-866b-4728-82f4-10e3225eac5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:58:17.627030 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04449b2-866b-4728-82f4-10e3225eac5c service neutron] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:58:17.647655 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 623/1253] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:58:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 20:58:21.286446 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41c6eb-d667-4f47-b408-ece97dd203db None None] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:58:21.287051 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41c6eb-d667-4f47-b408-ece97dd203db None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:58:21.287186 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41c6eb-d667-4f47-b408-ece97dd203db None None] PATH_INFO: `/` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:58:21.288646 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 631/1254] 10.222.0.57 () {54 vars in 921 bytes} [Sat Jul 2 20:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:58:21.324781 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b974d87-3c67-40c2-adf2-29574dd8d9a3 None None] REQUEST_METHOD: `POST` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:58:21.325381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b974d87-3c67-40c2-adf2-29574dd8d9a3 None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:58:21.325381 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b974d87-3c67-40c2-adf2-29574dd8d9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:58:21.425283 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.auth.core [None req-7b974d87-3c67-40c2-adf2-29574dd8d9a3 None None] MFA Rules not processed for user `f2377f751a584f678c0ddebc4de0ae44`. Rule list: `[]` (Enabled: `True`). {{(pid=98933) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:58:21.426521 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-7b974d87-3c67-40c2-adf2-29574dd8d9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:58:21.437299 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 624/1255] 10.222.0.57 () {58 vars in 1018 bytes} [Sat Jul 2 20:58:21 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 02 20:58:21.446444 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41c6eb-d667-4f47-b408-ece97dd203db None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:58:21.460323 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae41c6eb-d667-4f47-b408-ece97dd203db None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:58:21.465984 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfb076-4619-482c-9141-30b7a70ee4b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2377f751a584f678c0ddebc4de0ae44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:58:21.466634 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfb076-4619-482c-9141-30b7a70ee4b6 service placement] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:58:21.466931 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfb076-4619-482c-9141-30b7a70ee4b6 service placement] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:58:21.467215 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfb076-4619-482c-9141-30b7a70ee4b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:58:21.477422 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bfb076-4619-482c-9141-30b7a70ee4b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:58:21.479160 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bfb076-4619-482c-9141-30b7a70ee4b6 service placement] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:58:21.489961 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 632/1256] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:58:21 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:58:24.609121 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ebf58-cf30-4d57-84c5-772c70bddd0f None None] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:58:24.609641 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ebf58-cf30-4d57-84c5-772c70bddd0f None None] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:58:24.609792 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ebf58-cf30-4d57-84c5-772c70bddd0f None None] PATH_INFO: `/` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:58:24.611511 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 625/1257] 10.222.0.57 () {54 vars in 921 bytes} [Sat Jul 2 20:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 02 20:58:24.648967 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6fff3-7298-4e85-b7cb-09c824ace66f None None] REQUEST_METHOD: `POST` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:58:24.649482 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6fff3-7298-4e85-b7cb-09c824ace66f None None] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:58:24.649571 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a6fff3-7298-4e85-b7cb-09c824ace66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:58:24.682718 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.auth.core [None req-56a6fff3-7298-4e85-b7cb-09c824ace66f None None] MFA Rules not processed for user `f2377f751a584f678c0ddebc4de0ae44`. Rule list: `[]` (Enabled: `True`). {{(pid=98934) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 02 20:58:24.682718 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-56a6fff3-7298-4e85-b7cb-09c824ace66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:58:24.685505 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ebf58-cf30-4d57-84c5-772c70bddd0f None None] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:58:24.691980 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 633/1258] 10.222.0.57 () {58 vars in 1018 bytes} [Sat Jul 2 20:58:24 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 02 20:58:24.705638 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85ebf58-cf30-4d57-84c5-772c70bddd0f None None] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:58:24.711829 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6fff3-7298-4e85-b7cb-09c824ace66f None None] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:58:24.722997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbd2f0-4793-4a45-b2e7-93091f0199ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:58:24.723323 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a6fff3-7298-4e85-b7cb-09c824ace66f None None] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:58:24.724102 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbd2f0-4793-4a45-b2e7-93091f0199ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:58:24.724526 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbd2f0-4793-4a45-b2e7-93091f0199ca admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:58:24.724803 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbbd2f0-4793-4a45-b2e7-93091f0199ca admin admin] PATH_INFO: `/v3/users/d4d76e56460546e1ab7c7edee1d8e241` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:58:24.726111 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbbd2f0-4793-4a45-b2e7-93091f0199ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4d76e56460546e1ab7c7edee1d8e241)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:58:24.728161 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbbd2f0-4793-4a45-b2e7-93091f0199ca admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:58:24.729812 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebc66d-c448-4437-94da-21186bb4c955 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2377f751a584f678c0ddebc4de0ae44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:58:24.730572 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebc66d-c448-4437-94da-21186bb4c955 service placement] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:58:24.730933 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebc66d-c448-4437-94da-21186bb4c955 service placement] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:58:24.731280 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ebc66d-c448-4437-94da-21186bb4c955 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:58:24.745399 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebc66d-c448-4437-94da-21186bb4c955 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:58:24.747201 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ebc66d-c448-4437-94da-21186bb4c955 service placement] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:58:24.755997 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:58:24.758330 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 634/1259] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:58:24 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 02 20:58:24.784588 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-2fbbd2f0-4793-4a45-b2e7-93091f0199ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4d76e56460546e1ab7c7edee1d8e241'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:58:24.793788 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-2fbbd2f0-4793-4a45-b2e7-93091f0199ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4d76e56460546e1ab7c7edee1d8e241'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:58:24.801061 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-2fbbd2f0-4793-4a45-b2e7-93091f0199ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4d76e56460546e1ab7c7edee1d8e241'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:58:24.801746 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-2fbbd2f0-4793-4a45-b2e7-93091f0199ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4d76e56460546e1ab7c7edee1d8e241'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:58:24.802362 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-2fbbd2f0-4793-4a45-b2e7-93091f0199ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4d76e56460546e1ab7c7edee1d8e241'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:58:24.819575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 626/1260] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jul 2 20:58:24 2022] DELETE /identity/v3/users/d4d76e56460546e1ab7c7edee1d8e241 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:58:25.019496 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebc66d-c448-4437-94da-21186bb4c955 service placement] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:58:25.030186 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ebc66d-c448-4437-94da-21186bb4c955 service placement] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:58:25.101900 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64089e8b-8c89-4853-bce5-33f0fed667b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:58:25.102776 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64089e8b-8c89-4853-bce5-33f0fed667b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:58:25.103077 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64089e8b-8c89-4853-bce5-33f0fed667b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:58:25.103348 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64089e8b-8c89-4853-bce5-33f0fed667b8 admin admin] PATH_INFO: `/v3/projects/45b48e90ef7440f4904feb460c7e7582` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:58:25.104574 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64089e8b-8c89-4853-bce5-33f0fed667b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45b48e90ef7440f4904feb460c7e7582)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:58:25.106465 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64089e8b-8c89-4853-bce5-33f0fed667b8 admin admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:58:25.158004 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-64089e8b-8c89-4853-bce5-33f0fed667b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45b48e90ef7440f4904feb460c7e7582', 'request_id': 'req-64089e8b-8c89-4853-bce5-33f0fed667b8'} {{(pid=98934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:58:25.167094 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-64089e8b-8c89-4853-bce5-33f0fed667b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45b48e90ef7440f4904feb460c7e7582', 'request_id': 'req-64089e8b-8c89-4853-bce5-33f0fed667b8'} {{(pid=98934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:58:25.172566 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-64089e8b-8c89-4853-bce5-33f0fed667b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45b48e90ef7440f4904feb460c7e7582', 'request_id': 'req-64089e8b-8c89-4853-bce5-33f0fed667b8'} {{(pid=98934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:58:25.196325 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-64089e8b-8c89-4853-bce5-33f0fed667b8 admin admin] The token cache is being invalidate because project 45b48e90ef7440f4904feb460c7e7582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 20:58:25.196610 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-64089e8b-8c89-4853-bce5-33f0fed667b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:58:25.197260 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-64089e8b-8c89-4853-bce5-33f0fed667b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:58:25.198846 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 635/1261] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jul 2 20:58:25 2022] DELETE /identity/v3/projects/45b48e90ef7440f4904feb460c7e7582 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:58:25.203394 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbd2f0-4793-4a45-b2e7-93091f0199ca admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:58:25.204963 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-2fbbd2f0-4793-4a45-b2e7-93091f0199ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:58:25.218719 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbbd2f0-4793-4a45-b2e7-93091f0199ca admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:58:25.276900 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58728076-0a39-4f32-8fae-aaf99a2f3f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:58:25.277716 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58728076-0a39-4f32-8fae-aaf99a2f3f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:58:25.278024 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58728076-0a39-4f32-8fae-aaf99a2f3f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:58:25.278289 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58728076-0a39-4f32-8fae-aaf99a2f3f48 admin admin] PATH_INFO: `/v3/users/1aba3a08f67c467c8e8067ba59668feb` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:58:25.279515 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58728076-0a39-4f32-8fae-aaf99a2f3f48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1aba3a08f67c467c8e8067ba59668feb)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:58:25.281449 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58728076-0a39-4f32-8fae-aaf99a2f3f48 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:58:25.330609 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-58728076-0a39-4f32-8fae-aaf99a2f3f48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1aba3a08f67c467c8e8067ba59668feb'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:58:25.339610 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-58728076-0a39-4f32-8fae-aaf99a2f3f48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1aba3a08f67c467c8e8067ba59668feb'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:58:25.346632 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-58728076-0a39-4f32-8fae-aaf99a2f3f48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1aba3a08f67c467c8e8067ba59668feb'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:58:25.347326 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-58728076-0a39-4f32-8fae-aaf99a2f3f48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1aba3a08f67c467c8e8067ba59668feb'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:58:25.348004 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-58728076-0a39-4f32-8fae-aaf99a2f3f48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1aba3a08f67c467c8e8067ba59668feb'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:58:25.364826 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 627/1262] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jul 2 20:58:25 2022] DELETE /identity/v3/users/1aba3a08f67c467c8e8067ba59668feb => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:58:25.540439 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64089e8b-8c89-4853-bce5-33f0fed667b8 admin admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:58:25.541944 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-64089e8b-8c89-4853-bce5-33f0fed667b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:58:25.555741 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64089e8b-8c89-4853-bce5-33f0fed667b8 admin admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:58:25.610245 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:58:25.624520 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b09e9-eb83-4a22-9261-b09f76a3a891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:58:25.625396 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b09e9-eb83-4a22-9261-b09f76a3a891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:58:25.625672 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b09e9-eb83-4a22-9261-b09f76a3a891 admin admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:58:25.625943 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80b09e9-eb83-4a22-9261-b09f76a3a891 admin admin] PATH_INFO: `/v3/projects/961fa45d741f4dcdae61c64ce77ce023` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:58:25.627255 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b09e9-eb83-4a22-9261-b09f76a3a891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=961fa45d741f4dcdae61c64ce77ce023)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:58:25.629297 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80b09e9-eb83-4a22-9261-b09f76a3a891 admin admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:58:25.677817 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-e80b09e9-eb83-4a22-9261-b09f76a3a891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '961fa45d741f4dcdae61c64ce77ce023', 'request_id': 'req-e80b09e9-eb83-4a22-9261-b09f76a3a891'} {{(pid=98934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:58:25.688553 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-e80b09e9-eb83-4a22-9261-b09f76a3a891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '961fa45d741f4dcdae61c64ce77ce023', 'request_id': 'req-e80b09e9-eb83-4a22-9261-b09f76a3a891'} {{(pid=98934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:58:25.700774 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-e80b09e9-eb83-4a22-9261-b09f76a3a891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '961fa45d741f4dcdae61c64ce77ce023', 'request_id': 'req-e80b09e9-eb83-4a22-9261-b09f76a3a891'} {{(pid=98934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:58:25.715014 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-e80b09e9-eb83-4a22-9261-b09f76a3a891 admin admin] The token cache is being invalidate because project 961fa45d741f4dcdae61c64ce77ce023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 20:58:25.715295 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-e80b09e9-eb83-4a22-9261-b09f76a3a891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:58:25.715988 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-e80b09e9-eb83-4a22-9261-b09f76a3a891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:58:25.717581 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 636/1263] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jul 2 20:58:25 2022] DELETE /identity/v3/projects/961fa45d741f4dcdae61c64ce77ce023 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:58:35.361353 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=73,keystone:DELETE=16,keystone:INSERT=2 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:58:35.710005 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=30,keystone:DELETE=7,keystone:INSERT=1 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:58:43.239602 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58728076-0a39-4f32-8fae-aaf99a2f3f48 admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:58:43.241294 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-58728076-0a39-4f32-8fae-aaf99a2f3f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:58:43.322257 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58728076-0a39-4f32-8fae-aaf99a2f3f48 admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:58:43.395614 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b254203-6874-4948-82e0-b0a9293e3fb1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2377f751a584f678c0ddebc4de0ae44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:58:43.396286 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b254203-6874-4948-82e0-b0a9293e3fb1 service placement] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:58:43.396562 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b254203-6874-4948-82e0-b0a9293e3fb1 service placement] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:58:43.396835 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b254203-6874-4948-82e0-b0a9293e3fb1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:58:43.399287 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-6b254203-6874-4948-82e0-b0a9293e3fb1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:58:43.411227 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b254203-6874-4948-82e0-b0a9293e3fb1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:58:43.412850 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b254203-6874-4948-82e0-b0a9293e3fb1 service placement] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:58:43.424421 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 628/1264] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:58:43 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:58:53.420297 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=58 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:59:41.541357 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b09e9-eb83-4a22-9261-b09f76a3a891 admin admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:59:41.542807 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-e80b09e9-eb83-4a22-9261-b09f76a3a891 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:59:41.601477 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80b09e9-eb83-4a22-9261-b09f76a3a891 admin admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:59:41.605854 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e0147-aac5-4210-99b5-15c4be3645e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bfcc022be567428db48e7b2a71d9c069', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:59:41.606513 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e0147-aac5-4210-99b5-15c4be3645e6 service neutron] REQUEST_METHOD: `GET` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:59:41.606824 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e0147-aac5-4210-99b5-15c4be3645e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:59:41.607125 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4e0147-aac5-4210-99b5-15c4be3645e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:59:41.609302 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-ba4e0147-aac5-4210-99b5-15c4be3645e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:59:41.676973 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e0147-aac5-4210-99b5-15c4be3645e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:59:41.678422 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4e0147-aac5-4210-99b5-15c4be3645e6 service neutron] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:59:41.689373 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 637/1265] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 20:59:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 20:59:48.288312 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b254203-6874-4948-82e0-b0a9293e3fb1 service placement] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:59:48.289822 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-6b254203-6874-4948-82e0-b0a9293e3fb1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:59:48.305132 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b254203-6874-4948-82e0-b0a9293e3fb1 service placement] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:59:48.309722 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4c7c8-518b-40da-b14a-8698ed8544bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:59:48.310605 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4c7c8-518b-40da-b14a-8698ed8544bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:59:48.311022 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4c7c8-518b-40da-b14a-8698ed8544bf admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:59:48.311458 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd4c7c8-518b-40da-b14a-8698ed8544bf admin admin] PATH_INFO: `/v3/users/fb9bfe743c9c48839671e43638026bb8` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:59:48.325739 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4c7c8-518b-40da-b14a-8698ed8544bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb9bfe743c9c48839671e43638026bb8)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:59:48.328336 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd4c7c8-518b-40da-b14a-8698ed8544bf admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:59:48.383966 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-2fd4c7c8-518b-40da-b14a-8698ed8544bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb9bfe743c9c48839671e43638026bb8'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:59:48.392231 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-2fd4c7c8-518b-40da-b14a-8698ed8544bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb9bfe743c9c48839671e43638026bb8'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:59:48.399436 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-2fd4c7c8-518b-40da-b14a-8698ed8544bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb9bfe743c9c48839671e43638026bb8'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:59:48.400126 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-2fd4c7c8-518b-40da-b14a-8698ed8544bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb9bfe743c9c48839671e43638026bb8'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:59:48.400735 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-2fd4c7c8-518b-40da-b14a-8698ed8544bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb9bfe743c9c48839671e43638026bb8'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:59:48.417750 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 629/1266] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jul 2 20:59:48 2022] DELETE /identity/v3/users/fb9bfe743c9c48839671e43638026bb8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:59:48.599836 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e0147-aac5-4210-99b5-15c4be3645e6 service neutron] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:59:48.609703 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4e0147-aac5-4210-99b5-15c4be3645e6 service neutron] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:59:48.670622 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2490d2-d0ca-4470-a4e0-a7515530ebb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:59:48.671517 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2490d2-d0ca-4470-a4e0-a7515530ebb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:59:48.671798 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2490d2-d0ca-4470-a4e0-a7515530ebb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:59:48.672061 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2490d2-d0ca-4470-a4e0-a7515530ebb4 admin admin] PATH_INFO: `/v3/projects/c6161dd830234c089769600f91e5cfc0` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:59:48.683549 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2490d2-d0ca-4470-a4e0-a7515530ebb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6161dd830234c089769600f91e5cfc0)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:59:48.685502 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2490d2-d0ca-4470-a4e0-a7515530ebb4 admin admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:59:48.739576 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:59:48.743869 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-5a2490d2-d0ca-4470-a4e0-a7515530ebb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6161dd830234c089769600f91e5cfc0', 'request_id': 'req-5a2490d2-d0ca-4470-a4e0-a7515530ebb4'} {{(pid=98934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:59:48.751681 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-5a2490d2-d0ca-4470-a4e0-a7515530ebb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6161dd830234c089769600f91e5cfc0', 'request_id': 'req-5a2490d2-d0ca-4470-a4e0-a7515530ebb4'} {{(pid=98934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:59:48.757704 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-5a2490d2-d0ca-4470-a4e0-a7515530ebb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6161dd830234c089769600f91e5cfc0', 'request_id': 'req-5a2490d2-d0ca-4470-a4e0-a7515530ebb4'} {{(pid=98934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:59:48.769665 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-5a2490d2-d0ca-4470-a4e0-a7515530ebb4 admin admin] The token cache is being invalidate because project c6161dd830234c089769600f91e5cfc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 20:59:48.769885 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-5a2490d2-d0ca-4470-a4e0-a7515530ebb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:59:48.770515 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-5a2490d2-d0ca-4470-a4e0-a7515530ebb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:59:48.772085 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 638/1267] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jul 2 20:59:48 2022] DELETE /identity/v3/projects/c6161dd830234c089769600f91e5cfc0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:59:48.776210 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4c7c8-518b-40da-b14a-8698ed8544bf admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:59:48.777644 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-2fd4c7c8-518b-40da-b14a-8698ed8544bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:59:48.791867 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd4c7c8-518b-40da-b14a-8698ed8544bf admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:59:48.854310 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679ba8c-64d7-4871-82ae-0c04b5dcfcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:59:48.855217 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679ba8c-64d7-4871-82ae-0c04b5dcfcd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:59:48.855494 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679ba8c-64d7-4871-82ae-0c04b5dcfcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:59:48.855734 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f679ba8c-64d7-4871-82ae-0c04b5dcfcd6 admin admin] PATH_INFO: `/v3/users/8a1f070244384f20a74c70dfe0b597b1` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:59:48.869317 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679ba8c-64d7-4871-82ae-0c04b5dcfcd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a1f070244384f20a74c70dfe0b597b1)` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:59:48.871385 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f679ba8c-64d7-4871-82ae-0c04b5dcfcd6 admin admin] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:59:48.920077 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-f679ba8c-64d7-4871-82ae-0c04b5dcfcd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a1f070244384f20a74c70dfe0b597b1'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:59:48.923849 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:59:48.929046 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-f679ba8c-64d7-4871-82ae-0c04b5dcfcd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a1f070244384f20a74c70dfe0b597b1'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:59:48.938630 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-f679ba8c-64d7-4871-82ae-0c04b5dcfcd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a1f070244384f20a74c70dfe0b597b1'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:59:48.939344 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-f679ba8c-64d7-4871-82ae-0c04b5dcfcd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a1f070244384f20a74c70dfe0b597b1'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:59:48.939974 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.notifications [None req-f679ba8c-64d7-4871-82ae-0c04b5dcfcd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a1f070244384f20a74c70dfe0b597b1'} {{(pid=98933) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:59:48.958422 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 630/1268] 10.222.0.57 () {58 vars in 1223 bytes} [Sat Jul 2 20:59:48 2022] DELETE /identity/v3/users/8a1f070244384f20a74c70dfe0b597b1 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:59:49.141174 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2490d2-d0ca-4470-a4e0-a7515530ebb4 admin admin] Authenticating user token {{(pid=98934) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 20:59:49.142752 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.fernet_utils [None req-5a2490d2-d0ca-4470-a4e0-a7515530ebb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98934) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 20:59:49.155756 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2490d2-d0ca-4470-a4e0-a7515530ebb4 admin admin] Validating token access rules against request {{(pid=98934) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 20:59:49.219530 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc6305-e3f7-4963-8b0b-84e6b3a951e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a74d0c542d434c4296a1d1b26dca9bac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48e1bdb53b064749bf22c6e982f8a7ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98934) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 20:59:49.220410 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc6305-e3f7-4963-8b0b-84e6b3a951e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 20:59:49.220692 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc6305-e3f7-4963-8b0b-84e6b3a951e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 20:59:49.220966 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc6305-e3f7-4963-8b0b-84e6b3a951e0 admin admin] PATH_INFO: `/v3/projects/56da4f78f5124863a6e8d6021f8e6d0c` {{(pid=98934) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 20:59:49.232037 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc6305-e3f7-4963-8b0b-84e6b3a951e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56da4f78f5124863a6e8d6021f8e6d0c)` {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 20:59:49.234196 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccc6305-e3f7-4963-8b0b-84e6b3a951e0 admin admin] RBAC: Authorization granted {{(pid=98934) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 20:59:49.282954 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-bccc6305-e3f7-4963-8b0b-84e6b3a951e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56da4f78f5124863a6e8d6021f8e6d0c', 'request_id': 'req-bccc6305-e3f7-4963-8b0b-84e6b3a951e0'} {{(pid=98934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:59:49.291793 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-bccc6305-e3f7-4963-8b0b-84e6b3a951e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56da4f78f5124863a6e8d6021f8e6d0c', 'request_id': 'req-bccc6305-e3f7-4963-8b0b-84e6b3a951e0'} {{(pid=98934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:59:49.297752 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-bccc6305-e3f7-4963-8b0b-84e6b3a951e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56da4f78f5124863a6e8d6021f8e6d0c', 'request_id': 'req-bccc6305-e3f7-4963-8b0b-84e6b3a951e0'} {{(pid=98934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:59:49.309081 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-bccc6305-e3f7-4963-8b0b-84e6b3a951e0 admin admin] The token cache is being invalidate because project 56da4f78f5124863a6e8d6021f8e6d0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=98934) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 02 20:59:49.309365 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-bccc6305-e3f7-4963-8b0b-84e6b3a951e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:59:49.309994 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG keystone.notifications [None req-bccc6305-e3f7-4963-8b0b-84e6b3a951e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=98934) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 02 20:59:49.312160 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: [pid: 98934|app: 0|req: 639/1269] 10.222.0.57 () {58 vars in 1232 bytes} [Sat Jul 2 20:59:49 2022] DELETE /identity/v3/projects/56da4f78f5124863a6e8d6021f8e6d0c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 02 20:59:58.955186 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=12,keystone:DELETE=2 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 20:59:59.306330 dv-osbrick-master-4-ceph devstack@keystone.service[98934]: DEBUG dbcounter [-] [98934] Writing DB stats keystone:SELECT=63,keystone:DELETE=11,keystone:INSERT=2 {{(pid=98934) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 02 21:03:50.134601 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679ba8c-64d7-4871-82ae-0c04b5dcfcd6 admin admin] Authenticating user token {{(pid=98933) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 02 21:03:50.136284 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-f679ba8c-64d7-4871-82ae-0c04b5dcfcd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:50.226224 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f679ba8c-64d7-4871-82ae-0c04b5dcfcd6 admin admin] Validating token access rules against request {{(pid=98933) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 02 21:03:50.309015 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a56dac-7b55-4f2f-bab9-0a8b6bbe1faf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2377f751a584f678c0ddebc4de0ae44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd684ec63e1c4d61819302c837dd4349', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98933) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 02 21:03:50.309679 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a56dac-7b55-4f2f-bab9-0a8b6bbe1faf service placement] REQUEST_METHOD: `GET` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 02 21:03:50.309961 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a56dac-7b55-4f2f-bab9-0a8b6bbe1faf service placement] SCRIPT_NAME: `/identity` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 02 21:03:50.310237 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a56dac-7b55-4f2f-bab9-0a8b6bbe1faf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=98933) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 02 21:03:50.312227 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.fernet_utils [None req-f2a56dac-7b55-4f2f-bab9-0a8b6bbe1faf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=98933) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 02 21:03:50.325070 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a56dac-7b55-4f2f-bab9-0a8b6bbe1faf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 02 21:03:50.327106 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a56dac-7b55-4f2f-bab9-0a8b6bbe1faf service placement] RBAC: Authorization granted {{(pid=98933) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 02 21:03:50.339575 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: [pid: 98933|app: 0|req: 631/1270] 10.222.0.57 () {60 vars in 1365 bytes} [Sat Jul 2 21:03:50 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 02 21:04:00.335099 dv-osbrick-master-4-ceph devstack@keystone.service[98933]: DEBUG dbcounter [-] [98933] Writing DB stats keystone:SELECT=62 {{(pid=98933) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}